Untitled Document 


Files are in Adobe format. 
Download the newest version from Adobe. 


13th ANNUAL SYSTEMS ENGI NEERING CONFERENCE MONDAY TUTORIAL 
SESSION 


“Achieving Acquisition Excellence Via Effective Systems Engineering” 
San Diego, CA 
25 - 28 October 2010 


Agenda 


Mon t r25, 201 


TRACK 1- SESSION A 
e 10480 -1A1 — Tutorial: Universial Architecture Description Framework, Mr. Jeffrey Grady, JOG System Engineering, INC- 


TRACK 4- SESSION A 
e 10805 —1A4 — Tutorial: Mentoring Fundamentals to Support Systems Engineering Workforce Development, Mr. Nicholas Torelli, ODDR&E/SE 


TRACK 6- SESSION A 
e 10748 — 1A6 — Tutorial: Risk Management and Beyond, Mr. Al Florence, The MITRE Coporation 


TRACK 8 - SESSION A 
e 10803 —- 1A8 — Tutorial: NCOIC Systems, Capabilities, Operations, Programs, and Enterprises (SCOPE) Model, Mr. Hans Polzer, Lockheed 
Martin 
TRACK 8 - SESSION D 
e 10770 -1D8 — Tutorial: NCOIC’s Network Centric Analysis Tool (NCAT TM), Dr. Todd Schneider, Raytheon Company 


2010SEMondayTutorials.html[4/1/2016 1:58:48 PM] 


The Seven Fundamentals of Mentoring 


Nicholas M. Torelli 


Systems Engineering Directorate 
Office of the Director, Defense Research and 
Engineering 
13th Annual NDIA Systems Engineering Conference 
October 25, 2010 


13% Annual NDIA SE Conf 


Oct 2010 Page-1 DISTRIBUTION STATEMENT A -- Cleared for public release by OSR on 20 October 2010 -- SR case number 11-S-0069 applies. 


Part I: Background 


Definition and Background 

Why We Need It 

Successful Mentoring 
Characteristics of a Good Mentor 
Benefits of Mentoring 

Protégés 

Mentoring Models 

Mentoring Relationships 

Tips for Mentoring 


Break 
Part II: Seven Fundamentals of Mentoring 
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Mentoring Takes Place Outside of a Manager-Employee Relationship 
Mentoring is Career Focused 

Mentoring Relationships are Personal and Confidential 

Mentoring Relationships Cross Job Boundaries 

Mentoring Identifies Unique Skills and Abilities 

Mentoring Provides Insight Into the Workings of the Organization 
Mentoring Communicates Organizational and Professional Values 
Poor Mentoring Practices 

Summary 
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DoD Systems Engineering 
Workforce 


Recruit: 
Highly Develop / Train: 


Mentors 


Qualified 


Develop / Train 


and Retain 4 


Workforce Size 


Recruit: 
Journeymen 
Retired Military 
SE FFRDCs 


Recruit: 
Interns 


35-45 45-55 >55 


25-35 
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Background: DoD SE Acquisition 
Workforce 


- Legislation And Policy Direction 
Current DoD Efforts 


- Systems Engineering - The Best Job in 
America? 
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Workforce Development 
Legislation and Policy 


- National Defense Authorization Act For FY 
2006 (NDAA FY06): Human Capital Strategic 
Plan 


- NDAA FY08: Section 852, DoD Acquisition 
Workforce Development Fund 

- NDAA FY09: Weapon Systems Acquisition 
Reform Act 


- 2010 SECDEF and USD(ATA&L) Efficiency 
Initiatives 
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Best Jobs in 
America 


Sales Director 


Sales and Marketing (97,000) : 
$140,000 | $239,000 - 


Business Analyst, IT - 
IT (125,000) F 


Attorney/Lawyer 


Legal (541,000) 


$82,600 | $119,000 © $115,000| $262,000 - : 
: - $150,000 | $228,000 - 


13" Annual NDIA SE Conf 
Oct 2010 Page-6 


IT Project Manager 
IT (174,000) 
$98,700 | $140,000 


Anesthesiologist 
Healthcare (23,000) 


$292,000 | $408,000 - 


Physician/General 
Practice 
Healthcare (90,000) 


Telecommunications 
Network Engineer 
fT (21,000) 
$86,200 | $130,000 


in America? 


Information Technology (88,000) 


Physician Assistant 


Healthcare (82,000) 


$90,900 | $124,000 - 


Certified Public 
Accountant 
Financial (189,000) 


- $74,200 | $138,000 ° 


Software Developer - 


IT (796,000) 
$79,400 | $116,000 


Human Resources 
Manager 
Other (226,000) 
$71,800 | $111,000 


Securities Trader 
Financial (17,000) 


> $113,000 | $491,000 ; 


Systems Engineer 


$87,100 | $130,000 


College Professor 
Education (278,000) 
$70,400 | $115,000 


Physical Therapist 
Healthcare (181,000) 
$74,300 | $98,100 


Pharmacist 
Healthcare (198,000) 


- $109,000 | $134,000 - 


Senior Financial 
Analyst 
Financial (127,000) 


- $79,900 | $109,000 


Education/Training 
Consultant 
Financial (23,000) 
$77,800 | $157,000 


Source: htto://www.focus.com/ 


Nurse Practitioner 
Healthcare (23,000) 


$85,200 | $113,000 


Computer/Network 
Security Consultant 
IT (13,000) 
$99,700 | $152,000 


> Occupational Therapist - 


Healthcare (107,000) 
$69,700 | $100,000 


- Physician/Obstetrician/ - 
- Gynecologist - 
Healthcare (14,000) 


$222,000 | $338,000 


wae? aa Room 

Physician 
Healthcare (22,000) 

$249,000 | $386,000 


Systems Engineer - The Best Job 


Key 


Job Title 


Sector (Total Jobs) 


Median salary | Top pay 


Intelligence Analyst 
Government (51,000) 


$82,500 | $115,000 


Nurse Anesthetist 
Healthcare (19,000) 
$157,000 | $214,000 


Clinical Psychologist 
Healthcare (57,000) 
$81,100 | $172,000 


Product Management 
Director 


> Sales and Marketing (17,000) 


$145,000 | $201,000 


Software Product 


Manager 
IT (37,000) 


= $106,000 | $148,000 


Psychiatrist 


Healthcare (20,000) 


> $177,000 | $279,000 - 


Selected interest areas 
highest paid Salary 
highest median Salary 
most flexibility 

most satisfaction 
benefit to society 
highest job growth 
highest low stress 
most security 

future growth 


Veterinarian 
Other (68,000) 
$83,900 | $157,000 


i/human-resources/best-jobs/_c 2010 Focus - Used with permission. 
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Technical workforce development initiatives across government, 
industry and academia: 


- Competency Assessments for technical management career 
fields (‘first look” in Q4 2010) 

- Competency-based certification standards to enable “raising 
the bar” for workforce performance 


- Flexible certification framework to encourage professional 
growth and provide the opportunity for subsequent 
progression to Program Management 


- Expanded collaboration with civilian universities and industry 
associations 
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Definition: Professional Mentoring Is Mentoring 
Between An Experienced Person, The Mentor, And A 
Less Experienced One, The Protégé, To Facilitate The 
Development Of The Protégé Professionally 


- The Intent Of The Mentoring Process Is To Facilitate 
The Pace And Quality Of The New Colleague's 
Development Into A Competent Practicing Professional 
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Successful Mentoring 


- The Most Successful Mentorships Are Those That Are 
Built On A Shared Understanding Of Both Parties’ 
Expectations From The Relationship, Positive Feelings 
About One Another, And A Lot Of Optimism About How 
The Relationship Will Benefit Them Both. 

- Mentoring Is:* 

- Opportunity To Learn From Someone Who Has “Lived It" 
- Sharing Experiences And Expertise 
- Support, Encouragement, Guidance, Advice 
- Reciprocal 
- Mentoring Is Not:* 
- A Therapy Or Venting Session 
- A Be-All-End-All Source For Development 
- Manager Replacement 


*Executive Mentoring Program: Executive Briefing Presentation. Dell, Inc. 


th 
a peice) oe elt DISTRIBUTION STATEMENT A -- Cleared for public release by OSR on 20 October 2010 -- SR case number 11-S-0069 applies. 


-Willing: Best Practice Indicates That Mentors Should 
Be Willing To Fill The Mentor Role And Not Be 
Pressured Into Mentoring. 


-Experienced: In General, A Mentor Should Have A 
Proven Track Record Of Positive Effect In The Work 
Environment. 


-Non-Judgmental: A Mentor-Protégé Relationship 
Focuses On Developing The Protégé Professionally And 
Personally. The Protégé Should Feel Free To Discuss 
Issues Openly And Honestly, Without Worrying About 
Negative Consequences On The Job. 


Would YOU Be a Good Mentor? 
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Characteristics of a Good Mentor 
(cont’d) 


- Good Communicator: 
- Is Able To Articulate Effective Instructional Strategies 
- Listens Attentively 
- Asks Questions That Prompt Reflection And Understanding 
- Offers Critiques In Positive And Productive Ways 
- Uses E-mail/Social Networking Effectively 
- Efficient With The Use Of Time 
- Conveys Enthusiasm, Passion For Profession 
- Is Discreet And Maintains Confidentiality 


- Professional Competence And Experience 
- Others ? 


13% Annual NDIA SE Conf 
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Able To Take Constructive Criticism 


Active Listener 

- Good Communicator 

- Willing To Stretch To Learn And Try New 
Things 

- Willing To Take Risks (Shoot Higher) 


- Be Able To Identify Long And Short Term 
Career Goals 


- Willing To Accept That Those Goals May Change 
- Others ? 
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Benefits of Mentoring for the 
Mentor 

Recruitment And Retention 

Improving Skills And Knowledge 

Learning Goes Both Ways 

Networking 

Helping Someone Succeed 

Personal Satisfaction 
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Benefits of Mentoring for the 
Protege 


Exposure To Best Practices And Lessons Learned 
- Networking 
- Receiving Critical Feedback In Key Areas: 


- Communications 

- Work Relationships 

- Technical Abilities 

- Change Management And Leadership Skills 

- Acquiring Specific Skills And Knowledge Relevant To 
Personal Goals 

Better Understanding Of Professional Growth Within 
The Organization 

- Insight Into The Organization's Culture And Unspoken 
Rules 

- Sharing Frustrations And Successes With Someone Who 
os Empathize With Where You Are In Your Career 
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-Junior colleague 
*Little/no job experience 


-Needs workplace "survival skills 


‘Needs briefings on "internal 
workings" and office politics 


Benefits of Mentoring for the 
Protege 


Polished colleague 
“Extensive job experience 


‘Demonstrates work-place "survival 
skills" 


‘Provides briefings on "internal 
workings" and office politics 


When you enter into a mentoring relationship, you and your protégé become 


professional partners. 
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Benefits of Mentoring for the 
Organization 


Enhances Strategic Mission Initiatives 
Enhances Recruiting and Encourages Retention 


- Reduces Turnover Rates 


- Improves Productivity 
Enhances Professional Development 


- Links Employees With Valuable Knowledge And 
Information With Those Employees In Need Of Such 
Information 


- Creates A Mentoring Culture For Continued Employee 
Growth And Development 


- Provides An Effective Mechanism For Quickly 
Answering Questions Or Concerns 
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The Tennessee Valley Ghani of Women in Hefenise (TVC WID) is building a dynamic 
Mentor Protégé Program that will provide professional development and networking 
opportunities in support of Women in Defense. The program is being designed in a way that 
recognizes and respects the needs, expectations, and life-demands of professional women and 
those just starting their careers. 


One of the essential steps in establishing a viable program is attracting a strong group of 
Mentors to anchor the first Cohort FY11 and we are now accepting brief bio/resumes from 
members who want to serve and are willing to commit to the following: 

eA minimum of 4 hours per month investment per Protégé (maximum of two Protégés allowed 
per Mentor) 

eA one year commitment to the Mentoring Program 

eA desire to grow professionally through Mentor-Protégé relationships 


Please express your interest by submitting a half page summary about yourself to include: 
eName 

¢Current Position 

¢Brief Career History (including years of professional experience) 

eLength of Time in Huntsville 

eEducation 

eRelevant Strengths, Skills, and Interests 

Why You Wish to Volunteer to be a Part of the FY11 TVC WID Mentoring Program 


Please include your contact information and email your Bio directly to Paulette Risher at 

AND Kathy Broad at no later than July 25rd. Our first 
year FY11 planning is underway and we are excited about the Mentoring Program being a 
rewarding and fun effort sustained by the diversity and leadership you bring to WID. 


Find People, Jobs, Answers, and More...... 


Mentors Helping Mentees 
Mentees Helping Mentors 


We all learn from each other. The main goal is to 
pair individuals up wth other individuals that can 
coach one another remotely. Please join the other 
site as well at mentormentee.collectivex.com so 
you may use the discussion groups. 


About this Group About this Group 
*Created: June 3, 2008 

*Type: Networking Group 

eMembers: 75 

eSubgroups: 2 

eOwner: 

eManagers: 

¢Website: 


Subgroups 


°4 members | 


°1 member | 
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-E-mentoring 


‘Another Model Allows The Mentor To Be A Referral 
Person, Not The Person With All Of The Answers 


-Self - Mentoring 


ASOK, I'M PUTTING 
YOU ON OUR SPECIAL 
SELF-MENTORING 


www.dilbert.com — scottadama®@aolcom 


DILBERT: (c) Scott Adams/Dist. by United Feature Syndicate, Inc. 


‘Traditional Mentor-protégé Relationship 


IF YOU HAVE ANY 
QUESTIONS WHAT- 
SOEVER, FEEL FREE 
TO TALK TO YOUR - 
SELF. 
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I'M THE MASTER +. 
OF NON-MONETARY 


a | aF/e ©2002 United Fasture Syndicate, ine. 
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DILBERT: (c) Scott Adams/Dist. by United Feature Syndicate, Inc. 


www.dilbert.com scottadamedacl.com 
S009 ©2007 Scott Adams, Inc./Dist. by UFS, Inc, 
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Matching Mentor with Protege 


‘Match Mentors And Protégés: Areas To Consider 
Are: 

— The Available And Willing Mentors 

— Mentor And Protégés' Strengths And Weaknesses 

— Learning Styles 


— Goals Of The Organization/Agency Or The Mentor 
Program 


“Matching is, without a doubt, the single most critical success factor to a formal 


corporate mentoring program". - Deb Bauer, Program Managers of Dell's Global 
Diversity Department 
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CNN World News 

August 25th, 2010 

10:20 AMET 

Mentoring session turns into a shootout 

Two coalition service members, an Afghan police officer and one 
civilian were killed in western Afghanistan on Wednesday when a 
mentoring session turned into a shootout, military officials said. 
Officials with NATO's International Security Assistance Force were 
trying to determine what caused the shooting. 

The shooting apparently happened during a mentoring session between 
coalition soldiers and the Afghan national police, coalition officials 
said ina statement. 

During the mentoring session, an Afghan officer began firing a gun 
and the coalition soldiers returned fire, the statement said. 

The incident, which occurred in the Badghis province, was followed by 
a demonstration by locals in the area, according to the statement. 
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Tips for Mentors 


e The First Session Should Take Place In Person, But 
May Be Conducted By E-mail Or On The Telephone 


e A Face-to-Face Meeting Should Be In A Neutral 
Setting Without Distractions Or Interruptions. 


e Discuss The Protégé's Expectations. 
- Where Do You Want Your Career To Go? 


- Develop A Meeting Schedule With Your Protégé 
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Tips for Mentors 


- Listen, Counsel, Coach, Advise On Career And Goal 


Setting To Help Protégé Develop Individual Career 
Development Plan 


- Evaluate Each Meeting With The Protégé 


- Most Mentor Research Describes That 90 Percent Of 


The Mentor-Protégé Relationships Work Out Well 


- When Developing A Mentor Program, The 
Organization/Agency Should Address How A Mentor 
And Protégé Pairing That Is Not Successful Will Be 
Handled 


- Conclude The Mentoring Process When Appropriate 


DISTRIBUTION STATEMENT A -- Cleared for public release by OSR on 20 October 2010 -- SR case number 11-S-0069 applies. 


MY DREAM IS TO 
SOMEDAY BE LIKE 


wwwodilbertcom  scottedams@acl.com 


DILBERT: (c) Scott Adams/Dist. by United Feature Syndicate, Inc. 
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T HOPE TO ADVANCE 
FROM BEING TOTALLY 
WORTHLESS TO BEING 
TOTALLY WORTHLESS 

AND OVERPAID. 


£20-07 e200 Scott Adame, inc./ Obst. by UFS, Inc. 
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BREAK 
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#1: Mentoring Takes Place 
Outside of a Manager-Employee 
Relationship, at the Mutual 
Consent of Mentor and Protégé. 
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#2: Mentoring is Career-Focused 
or Focuses on Professional 
Development that may be Outside 
a Protégé's Area of Work. 
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Focus on Professional 
Development 


ALICE, IT THOUGHT 
IT WAS TIME FOR 
US TO HAVE ALITTLE 
MENTORING SESSION. 


MAYBE WE CAN SKIP 

| THE PART WHERE I SAY 

YOU NEED TO BE MORE 

CONFIDENT AND SPEAK 
OUT AT MEETINGS. 


MAKE SENSE WHEN 
I’M MORE CAPABLE 
THAN YOU IN EVERY 
IMPORTANT WAY? 


DilberLeom  DilbertCartoonist@gmail.com 


ey] 
| 
uy 
Fy 
: 
i 
E 
: 
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#3: The Mentorship Relationship 
is Personal and Confidential; A 
Mentor Provides Both Professional 
and Personal Support. 
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#4: The Mentorship Relationship 
Crosses Job Boundaries. 
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#5: A Mentor Will Identify the 


Protégé's Unique Skills and 
Capabilities and Work With 
Him/Her to Make the Most of 
Those Talents. 
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T NEED 
CAREER 
ADVICE. 


THE SECOND CHOICE 
WILL SQUEEZE THE 
LIFE OUT OF YOU 
LIKE & VISE ON A 
PEACH, =~: 
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Identify the Protegeé's Unique Skills 


and Capabilities 


SHOULD I KEEP MY 


[| COMFORTABLE JOB 
| | THAT HAS NO 


GROWTH POTENTIAL? 


| YOU CAN'T LJIN. 


50 I RECOMMEND 
THE CHOICE THAT 
KEEPS YOU ALUAY 
FROM HOME MORE. 


f OR, SHOULD IT TAKE 


A BETTER JOB WITH 
LONGER HOURS AND 
A HIDEOUS COMMUTE? 


BECAUSE FRANKLY — 
AND TLL TAY TO SAY 
THIS DELICATELY - 

A LITTLE BIT OF YOU | 
GOES A LONG LAY, 


THE FIRST CHOICE IS 
A SURE PATH TO 
SELF-LOATHING 

AND UNHAPPINESS. 


THAT'S THE PROBLEM 
| WITH GOOD ADVICE 


NO ONE WANTS TO 
HEAR IT. 


#6: A Mentor Helps a Protégé 


Better Understand How the 
Organization Works (Those 
Aspects of the Organization that 
Aren't Written Down) 
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##7: A Mentor Should 
Communicate Professional and 
Organizational Values 
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Poor Mentoring Practices 


Canceling Appointments 


Not Providing Opportunities For The 
Protégé To Observe Work In Progress 


Disparaging The Organization/Agency's 
Processes, Procedures, Or Politics 


Mentor Tyranny, Manipulation or 
Politicking 
- Bad Protégé Actions 
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Summary 


- Give the Mentor-Protégé Relationship Structure 

- Recruit Carefully 

- Provide Protégé Training & Orientation 

- Define Expectations Up Front 

- Give Feedback 

- Prepare for the End 

- Benefit The Mentor, Protégé And The Organization 


As The Protégé Grows Professionally, The Amount Of Dependence 


Decreases, Until The Protégé Is Shaped Into An Independent And 
Competent Employee. 
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For Additional Information 


Nic Torelli 


ODDR&E/Systems Engineering 
703-695-2300 | nicholas.torelli@osd.mil 


Elizabeth Birdsall 


SAIC 
703-602-0851 x194 
elizabeth.birdsall.ctr@osd.mil 
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Gener JOG SYSTEM ENGINEERING 
GRAND SYSTEMS DEVELOPMENT TRAINING PROGRAM 
TUTORIAL 


UNIVERSAL ARCHITECTURE 
DESCRIPTION FRAMEWORK 


INTRODUCTION 


Presented By 
Jeffrey O. Grady 
President JOG System Engineering 
6015 Charae Street 
San Diego, CA 92122 
(858) 458-0121 
jeff@jogse.com jgrady@ucsd.edu 
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Who Is Jeff Grady? 


CURRENT POSITION 
President, JOG System Engineering, Inc. 
System Engineering Assessment, Consulting, and Education Firm 


PRIOR EXPERIENCE 


1954 -1964 U.S. Marines 
1964 - 1965 General Precision, Librascope Div 

Customer Training Instructor, SUBROC and ASROC ASW Systems 
1965 - 1982 Teledyne Ryan Aeronautical 

Field Engineer, AQM-34 Series Special Purpose Aircraft 

Project Engineer, System Engineer, Unmanned Aircraft Systems 
1982 - 1984 General Dynamics Convair Division 

System and Group Engineer, Cruise Missile, Advanced Cruise Missile 
1984 - 1993 General Dynamics Space Systems Division 

Functional Engineering Chief & Manager of Systems Development 


FORMAL EDUCATION 


SDSU, BA Math; UCSD, Systems Engineering Certificate; 
USC, MS Systems Management with Information Systems Certificate 


INCOSE First Elected Secretary, Fellow, Founder, Expert System Engineering Professional 


AUTHOR System Requirements Analysis (2), System Verification, System Integration, System 
Validation and Verification, System Engineering Planning and Enterprise Identity, 
System Engineering Deployment, System Synthesis, System Management 
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Systems Jeff Grady Worked On 


USAF/GD Convair AQM 129 


USNI/Librascope Advanced Cruise Missile a 
ASROC/SUBROC USAFIGD Atlas Missile 


Computer Systems 


USAF/Ryan AQM-81 Firebolt 1983 
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Ryan incobeelsonsbaln eda ee 


USAF/Ryan AQM-34L Tom Cat U.S. Navy/Ryan | a No 
58 Combat Missions Model 147SK “ USAFIRyan 
BGM-34C 
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Who is Attending? 


¢ Small class 
— Name 
— Place of employment 
— Modeling and requirements experience 


e Large class 


— At first break engage in conversation with someone you did 
not know when arriving for class 


— Discuss modeling and requirements work 
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Tutorial Outline 


Introduction 

Traditional structured analysis overview 
MSA/PSARE modeling overview and UADF construct 
UML/SysML modeling overview and UADF construct 
The future 


ak WN F 
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Enterprise Common Procss 


oe ENTERPRISE SS en a at Pe eae CUSTOMER 
“ VISION ~~ = NEEEO 


“ F = aa oS F 


BUSINESS 


SUPPLIER 
CONTROL : ee oe 2 
GRAND GRAND fF) GRAND : yal 
SYSTEMS SYSTEMS [| = 21 sysTEMS ' a ton 
DEFINITION ey SYNTHESIS | VERIFICATION | Be ap DISPOSED 
Fa2 oe ; F4 
a 2] Fag | 4 SYSTEM 


N NN plan PROGRAM Ss SPIRAL 


DEVELOPMENT a 


RAND SYSTEMS: 
DEVELOPMENT 
OVERLAY 
ASSURE 
PRODUCT 
AND PROCESS 
QUAL. 


| LESSONS) 
| LEARNED! 


ENTERPRISE: 
| SCOPE 


XX. REFER TO PROGRAM SYSTEM DEFINITION DOCUMENT FOR EXPANSION 
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Common Process Areas of Interest 


© 0G System Engineering. 


GRAND SYSTEM 
DEFINITION papi 
ACCOMPLISH MODELING aSGRKGAROR 
: MANAGE SYSTEM 
AND REQUIREMENTS MANAG SYEt MODELING AND SUES 
ANALYSIS WORK REQUIREMENTS a 
r- ANALYSIS 
UMIVERBAE VERIFICATION bell 
ARCHITECTURE REQUIREMENTS TOP 
ENABLE/ DESCRIPTION FRAMEWORK ANALYSIS [TOR DOWN . Fata4 VERIFICATION 
SELECT 
TiARITIONAL 2e[L. F4134 PLANNING BOTTOM PROCEDURES 
STRUCTURED F149 VERIFICATION > 
ANALYSIS af PLANNING 
Pritt AUDIT, ASSURE : F4t4A 
TRACEABILITY. 64 
MODERN INTEGRATE, AND | — 
STRUCTURED VALIDATE _ 
i ANALYSIS REQUIREMENTS 
(or 40[L neste Feit SYSTEM 
ARCHITECTURE 
Sree 2 vane x ee Eales mmx [err 
PRIOR WORK (OR ot PRODUCTS 
— F4142 F4t45 
a oo ® F41313 
CUSTOMER CAPTURE PUBLISH 
OBA REQUIREMENTS SPECIFICATIONS BOLO IGANG 
eel IN RAS 
F412 F41314 44 
F4443 "3 
SYSTEM 
MODELING & PREPARE DETAIL PRODUCT 
LANGUAGE SPECIFICATIONS DESIGNS 
@ F41315 
F4t4a 
DoDAF 
AND 
F4134 
eal. 41316 
F443 ioR 
= DOCUMENT 
DEVELOPMENT APPROVED DESIGN 
‘AND AND CONCEPTS CONCEPTS 
4430 F417 [ap 
UMENT 
SUPPORTING ee SIMULATIONS 
SIMULATION AND 
SIMULATION ANALYENG AND ANALYSES 
AND ANALYSIS, work PRoDUCTS |-}} 
F4133 F4148 
F443 F444 
FAA 


The Foundation of System Engineering 
Knowledge Grows & We Have Our Limitations 


EXPANDING 
KNOWLEDGE 


SPECIALIZATION 
EFFECTS 


IT WON'T 


ALL FIT! 
LIMITATIONS 


a 
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We Are All Specialists 
Systems Are Developed by People Sharing Knowledge 


BREADTH OF KNOWLEDGE 


DEPTH OF KNOWLEDGE 


V4//A GENERALIST KNOWLEDGE BASE 
[-] DOMAIN KNOWLEDGE BASE 
Ee ~SOPECIALIST KNOWLEDGE BASE 
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Models Support Information Sharing 
During Early Development 


¢ When developing an unprecedented system it is 
helpful to model it as a way of learning more 
about it 

¢ We have no reality to observe in the beginning so 
we must model 
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Bran Selic’s Model Characteristics 


The use of abstraction to emphasize important 
aspects while removing irrelevant ones. 
Expressed in a form that is really understandable 
by observers. 

Fully and accurately represents the modeled 
system. 

Predictive such that it can be used to derive 
correct conclusions about the modeled system. 
Inexpensive meaning it is much cheaper to 
construct and study than simply building and 
observing the modeled system. 
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We Apply Models For Good Reasons 


FUNCTIONAL 
FACET 


2. = = oe 
os = es 8 68 
= = = 8 ws 8 6 
= = = = es eee 
4 2 = = = 8» 8 8 8 8 
a 5 s es es ee oe ee 
Ce i) 
- = = » es es es ee eee 
» = # = = © 8 ee ee eee 
=e 8 8 ee ee ele eel ee 
| 
ee 
=e es es es es ee ee eee ele 
ee ee \ 
4keeee ee elle eee 
428 = 3 » = es es es ee ee oe ee 
7 = = = eS ee ee ee ee ee 
ee 
= ss es 8 6 =e. 2 ew oe oe eo | 
=e es es 8 8 \ 
Je 8 8 8 8 hie UlUllUlUlUlUllUel 
se es es 8 os eee llc lc lc lc ll 
ss 5 8 8 8 SRP e@e eee lcthlUlclhlUclhlUc lc ll 
ss se se eos Bee eeeelmFmlUcmCmlUlcmmlUchmlUchlc lel 
ee ee 
ee en 
Ce | 
oie 
ss = 8 8 2 es es ew ee eee eee ee ele 


eee HAND-EYE b 


Seely ite en eaee ene Va 2S COORDINATION 


Ce ee ee 
ee ee 
Ce ee | 
Ce ee ee 
Ce ee ee | 
‘= =» # @ 


BEHAVIORAL 
FACET 


ANALYST 
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Visual Complexity Continuum 
Some Models Are Richer Than Others 


¢ Some models are visually simple like functional 
flow diagramming 


— Ideas flow readily from model into the human mind through 
vision because of the simple graphics 


— Notavery rich story comes through 


e Other models are more visually complex like 
IDEF-0, EFFBD, DODAF 
— The picture does not transfer so easily into the mind visually 
— DODAF includes 26 different artfacts 
— But it conveys a very rich story when it gets there 
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Modeling Sequencing 


Top-Down 


j 
yYy Form Follows Function 
Wi and Top-Down 


Bottom-Up 


Static 
First 
First 


- 
= 
se) 
= 
> 
a) 


VERSION 12.0 2282A-1-15 © JOG System Engineering 


Which Comes First? 


NEED Instant 
F Allocation 
SYSTEM 
Mission A 
Lower Tier ~—_ Analysis 
Functional 
Analysis eta 
Continuing System 
Allocation Entities System 


Relationships 
L = a2 


Clearly the functionality 
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Architecture First Counter-Argument 


¢ Early OOA authors all supported object entry into the 
problem space with DFD and state machine examination of 
objects 

¢ Exactly opposite to Sullivan’s idea of form follows function 

e Murray Cantor’s “Thoughts on Functional Decomposition” 
in The Rational Edge offers the best printed argument for 
this approach 

¢ Principal argument seems to be that multiple lower tier 
alternative solutions will appear in the product but this isa 
failure of lower tier system integration and optimization and 
the standard PMP concept can be employed with software 
as well as hardware 
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Model Orientation Relative to 
Dynamic and Static Components 


STATIC COMPONENT DYNAMIC COMPONENTS 
MULTI-FACETED PRODUCT ENTITY FUNCTIONAL BEHAVIOR 
MODELS FACET FACET FACET 


TRADITIONAL ARCHITECTURE FUNCTIONAL SCHEMATIC 
STRUCTURED BLOCK FLOW BLOCK 
ANALYSIS DIAGRAM DIAGRAM DIAGRAM 


MODERN HIERARCHICAL DATA FLOW P SPEC, STATE 
STRUCTURED DIAGRAM DIAGRAM DIAGRAM 
ANALYSIS AND HP 


EARLY OBJECT- CLASS AND DATA FLOW STATE 
ORIENTED ANALYSIS | OBJECT DIAGRAM DIAGRAM DIAGRAM 


UML VARIATION CLASS AND OBJECT USE CASES AND @j] SEQUENCE DIAGRAM, 

OF OOA DIAGRAM, COMPONENT ACTIVITY DIAGRAM STATECHART, AND 
DIAGRAM, AND DEPLOY- COMMUNICATION 
MENT DIAGRAM DIAGRAM 


SysML BLOCK DIAGRAMS USE CASES AMD © SEQUENCE DIAGRAM 
ACTVITY DIAGRAM AND STATECHART 


® ANALYTICAL ENTRY FACET 
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The History of Requirements Modeling 


USE OF LINKED 
EXECUTABLE 
EARLY SOFTWARE 
MODERN OOA PATI 
STRUCTURED 
ANALYSIS 


FLOW 
CHARTING 


AND HARDWARE 
1950s PATH | 
TRADITIONAL 
STRUCTURED 
ANALYSIS 


The First Objective of Modeling 
- Requirements Identification 


® Something wanted or =—HW——_» 
necesSary. ae 

® Something essential 
to the existence or 


occurrence of 
something else. 


@ A necessary character- 
istic or attribute of some 
thing (or item). 
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Requirement Types 


¢ System composition 
— What does the system consist on in terms of entities? 
— What relationships (interfaces) must exist between them? 


e¢ Entity and relationship essential characteristics 
— Performance (Functional) 
¢ What does it have to do and how well does it have to do it? 
— Design constraints (Non-functional) 


¢ Boundary conditions that the design team must remain within 
while satisfying performance requirements of three kinds 
— Interface 
— Specialty Engineering/Quality 
— Environmental 
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Writing Requirements is not Difficult 


¢ The hard job is 


Knowing what to write them about and 
Determining numerical values that should be in them 


¢ Thus we use models to gain insight into the essential 
characteristics 


The models are composed of simple graphics 


Model symbols (lines, block, bubbles, ....) relate to requirements that 
are derived from the model 


The models encourage completeness and avoidance of unnecessary 
content 


Models focus our human thought processes 


e And good engineering to determine appropriate values 
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Requirement Primitive Form 


¢ The subject identifies the attribute that must be 
controlled 


¢ A form of the verb shall shows the degree of 
determination that the design must possess a 
capability. 

¢ The remainder of the sentence provides a value 
and the relationship between the value and the 
attribute. 


e In primitive form: 
Speed > 695 knots 
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VERSION 12.0 


What Is a Specification? 


A specification is 
a document that 
contains all of 
the essential 
characteristics 


™%) _— for a given item. 
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Must itbea 
paper document? 


© JOG System Engineering 


In Writing a Specification, What Is the 
Target? 
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Requirements Derivation Strategies 


STRUCTURED 


REESTYLE IS FOR 
ECOMPOSITION 


DERIVATION & 


EXPERTS AND 
OTHER FOOLS 
STRUCTURED 
ANALYSIS FREESTYLE 
OR AD HOC 


THE CUSTOMER 
INTERVIEW 
APPROACH 
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A Universal Model for the Future? 


NOT FULLY 
SUPPORTED? 


Alternative UADF THREE-TIER SPECIALTY 
Using PSARE ENVIRONMENTAL ENGINEERING 
MODEL SCOPING MATRIX 
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UADF Modeling Artifacts Summary 


UNIVERSAL ARCHITECTURE 
DESCRIPRION FRAMEWORKS 
FUNCTIONAL MSA-PSARE UML-SYSML 


PRODUCT SUPPER ener 
LIFE LINES OR 
ENTITY ALLOCATION BUBBLES ACTIVITY DIAG 


DEFINITION SWIM LANES 


Ha OE AMS: | DEDICFD,P-SPEC, | USE CASE, 
PERFORMANCE C-SPEC, AND DATA| SEQUENCE, 
REQUIREMENTS Fascia DICTONARY ACTIVITY, AND 


DIAGRAMS, OR 
ENHANCED FFBD STATE DIAGRAMS 


ope DIRECTED LINE 

x SEGMENTS THAT 
INTERFACE SCHEMATIC CROSS SUPER 

REQUIREMENTS BLOCK BUBBLE 


DIAGRAM BOUNDARIES 


DIRECTED LINE 
SEGMENTS THAT 
JOIN LIFE LINES 


H SPECIALTY 
SPECIALTY Hk ENGINEERING ENGINEERING ENGINEERING 
ENGINEERING t SCOPING SCOPING SCOPING 
REQUIREMENTS | MATRIX 


PRODUCT ENTITY 
REQUIREMENTS 


INTS 
NG 


NSTRA 
oODEU 
EXTENSION 


ENVIRONMENTAL 
REQUIREMENTS 


CLASS/OBJECT 


DIAGRAM, 
PRODUCT ENTITY COMPONENT 


BLOCK AND ARCHITECTURE DIAGRAM, 


SOLUTION SPACE SCHEMATIC MODEL DEPLOYMENT 
MODELS BLOCK DIAGRAM DIAGRAM, BLOCK 


DEFINITION 
DIAGRAM, AND 
INTERNAL BLOCK 
DIAGRAM 
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Model Results Flow Into Specification 
Content 


Universal Specification 


Scope 
Models References 
Requirements 
Modeling (States and Modes) 
Need 
.1.2 User Requirements 
MSmPSARE .1.3_ Use Case Modeling 
Product Entity Modeling 
Interface Modeling 
Specialty Engineering 


Modeling 
1.7. Environmental Modeling 
: Capabilities 
' Interfaces 
‘ Specialty Engineering 
: Environmental 
Verification 
Alternative Paragraph Packaging and Shipping 
3.1.3 Structures Notes 
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tecture Perspective 


| Arch 


Development Life Cycle Overview 
From a Universa 


System 
Engineer 


Modeling 


[ 
fi 


prot 


ts 


iremen 


Requ 


Is 


Analys 
Sheet (RAS) 


Universal 
Specification 


Universal Architecture 


Description Framework 


Ineering 
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VERSION 12.0 


JOG SYSTEM ENGINEERING 
GRAND SYSTEMS DEVELOPMENT TRAINING PROGRAM 
TUTORIAL 


UNIVERSAL ARCHITECTURE 
DESCRIPTION FRAMEWORK 


TRADITIONAL STRUCTURED ANALYSIS 
OVERVIEW 
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Hardware and Systems Analysis 
Models 


¢ Traditional structured analysis 


¢ Sys 


VERSION 1 


Functional analysis 


Functional flow diagramming 

Enhanced functional flow diagramming, used in CORE 
Behavioral diagramming, used in RDD-100 derived from IPO 
IDEF 0 derived from SADT 

Process flow analysis 

Hierarchical functional analysis 

FRAT 


State diagramming 

Specialty engineering scoping and discipline-specific modeling 
Three-tier environmental requirements construct 

Product entity structure 

Requirements analysis sheet 


ML 
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The Big Bang Theory Of 


System Development 
THE TRADITIONAL SRA APPROACH 


EVERYTHING FLOWS FROM ONE IDEA, 


CL 


THE 


BA-BA-BA-BANG 


THE ULTIMATE FUNCTION 
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The Beginning of 
Functional Decomposition 


peti INSTANT _ 
ALLOCATION SYSTEM 
STATEMENT 
NN Nv 
FUNCTIONAL CONTINUING PRODUCT ENTITY 
DECOMPOSITION ~ FUNCTION ——" - peFinition 


ALLOCATION 
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e Current System Developmen 
Paradigm 


7” | ENTERPRISE 2S — = a CUSTOMER 
2 VISION a -- NEEEO 
“ 7 Si 


SUPPLIER 
GRAND GRAND 


SYSTEMS 
SYSTEMS 
VERIFICATION SUSTAINMENT 


: Fi DISPOSED 
ha SYSTEM 


SUPPLIER 3 


MATERIAL SPIRAL 
DEVELOPMENT 


RAND SYSTEMS GRAND SYSTEM 
DEVELOPMENT EMPLOYMENT 
OVERLAY OVERLAY 
ASSURE : 
PRODUCT 


ENTERPRI 
SCOPE iN 


\, 
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Functional Analysis and Allocation 


FUNCTIONAL FLOW DIAGRAM 


ALLOCATE FUNCTIONALITY 
TO THINGS IN SYSTEM MANUFACTURING BREAKDOWN 


STRUCTURE 
DRAWING BREAKDOWN STRUCTURE 
PERFORMANCE 
REQUIREMENTS WORK BREAKDOWN STRUCTURE 
> 


ANALYSIS 
PERFORMED ON 
ALLOCATED 
FUNCTIONALITY 


ae INTERFACE ANALYSIS 


PLACE ALLOCATED 7 _ MAKE-BUY PLAN 
ITEMS INTO SYSTEM DEVELOPMENT ORGANIZATION 


ARCHITECTURE ~~ §TRUCTURE 


CONFIGURATION ITEM ANALYSIS 
SPECIFICATION TREE DEVELOPMENT 
TEAM/PRINCIPAL ENGINEER ASSIGNMENT 


PERFORMANCE 
REQUIREMENTS 
FOR ITEM FUNCTION 
ALLOCATED TO 


CONSTRAINTS ANALYSIS 
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Functional Flow Diagramming Levels 


USING DECIMAL- 
DELIMINATED 
LEVEL NOTATION 


secon | [2h [2h [23] —o [29 
LEVEL ee 
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Functional Allocation Pacing 
Alternatives 


¢ Serial performance 


— Functional analysis until complete then allocate and 
conceptualize 


¢ Instant allocation 
— See function, allocate function 


¢ Layered allocation 
— FRAT concept 


¢ Progressive allocation 
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FRAT Layered Perspective 


SPSTEM FUNCTIONAL 
SrsarTey EAT Ty 


PERFOSMANCE REGLIREMENTS 


From the work of Bernard Morias and Brian Mar. 
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Progressive Tuning 
of the Functional Analysis 


— Concept Feedback —| 
Require- Concept 


ments ——>|  Develop- $< 
ment 


Functional 


Analysis 
Need y Analysis and 


Allocation 


Lower level functional analysis guided by higher level 
concept definition 


Results in tuning the action oriented functional flow 
diagram to a physical process diagram adequate for 
detailed logistics support analysis at lower tiers and 
environmental use profiling. 
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Use System Decomposition 


USE 
SYSTEM 


FAT 


PAEPARE TO 


Pp LOAD 
ARRAYS 


F471 


Deployable Sonar Array 


LOAD 
ARRAYS 


F472 


STORE AHRAY 
OPERATIONALLY 


FA7211 
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PAEPAHE ARRAY 
FOR 
DEPLOYMENT 

Fa7212 


USE SYSTEM 


OPERATE 
SYSTEM 


OWN SHIP 
DEPLOYMENT 
OPERATIONS 


TEST 
DEPLOYED 
ARRAY 
F47214 


ALTERNATE 
SHIP 
DEPLOYMENT 
OPERATIONS 


F4722 
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SHIP 
COLLECT DATA 


F4723 


STANDBY 


F4724 


OPERATE 
ARRAY 


F4725 


TEAMINATE 
AND DISPOSE 
OF ARRAY 
F4726 


OFF LOAD 
ARRAYS 


FAa74 
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Use System Decomposition 
AQM-81 USAF/Ryan Firebolt Target System 


USE 
TARGET 
SYSTEM 


F47 


USE 
TARGET 
SYSTEM 


LAUNCH 
AIRCRAFT 
RECYCLE 


F47F 


ASSOCIATE SYSTEMS SUPPORT 


COMBATANT RETRIEVAL 
AIRCRAFT SYSTEM 
RECYCLE RECYCLE 


F47D F47G 
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MISSION PLANNING 
AND PROGRAM 
DEVELOPMENT 
FA7E 
Y i Yi 
mervar | | unonwomo [x bof ognvecuer [lof uss meats 
SERVICING OPERATIONS OPERATIONS 
F475 F476 F477 F478 F479 
sLe Le ele ole als 
MANAGEMENT UNSCHEDULED INTERMEDIATE POST FLIGHT 
AND TARGET MAINTENANCE MAINTENANCE |g 
SUPERVISION MAINTENANCE (DRY) 
F47P F47M FA7N FA7A 
EADY POST FLIGHT 
morace TERGEE SYSTEM MABITENANGE 
<i— TES (WET) 
F474 F473 F47C 
se al wilt 
(6) SOME FLOW LINES ILLUSTRATED ON LOWER TIER DIAGRAMS NOT SHOWN 
HERE IN THE INTEREST OF CLARITY OF PRIMARY FLOW 
5) BLOCKS WITH # IN LOWER LEFT CORNER REQUIRE COMPUTER 
TARGET RECEIPT TARGET SOFTWARE. 
TARGET a AND STORAGE BUILDUP (4) BLOCKS WITH CORNER AT LOWER LEFT CORNER ARE EXPANDED ON THE 
AIR [4 )}-——> |e INDICATED SHEET NUMBER 
(3) REFER TO APPENDIX C FOR INTERFACE RELATIONSHIPS BETWEEN PRODUCT 
VEHICLE F471 F472 ENTITIES 
FROM Lb (2) REFER TO APPENDIX C FOR SYSTEM ARCHITECTURE 
pay SUPPLY 3 NOTES: (1) CODES IN LOWER RIGHT CORNER ARE TRA FUNCTIONAL CODES (FID). 
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Use System Decomposition 
| Atlas Space Transport System 


USE 
SYSTEM 
F47 
MISSION 
DATA PLAN 
TRANSPORT 
PAYLOAD MISSION 
STORE AND 
Mist PROCESS F47B 
PROCESS PAV Man 
UPPER F47S 
STAGE 
F475 
LAUNCH RECEIVE PROCESS INSTALL INTEGRATE ORaAATE INTEGRATE PREPARE 
VEHICLE LAUNCH LAUNCH SOLID UPPER PAYLOAD PAYLOAD B) VEHICLE FOR (105 
VEHICLE ROCKETS STAGE BS) CFAIRING LAUNCH 
VEHICLE 
F473 F476 F478 F479 FA7A F47C 
Fa71 
PROCESS 
SOLID LAUNCH = |_| MAINTAIN 
STORE ROCKETS ABORT READINESS 
LAUNCH F474 OPERATIONS 
VEHICLE F47F F47D 
F472 
PROCESS 
PAYLOAD 
FAIRING 
F477 
MAINTAIN PAD REFURBISH ; FLIGHT mrp retg © 
READINESS LAUNCH PAD piaPOse = OPERATIONS Fic yalcen 
F47N ATMA OF SOLIDS F47G FA7E 
Fa7H1 VACATE 
———— PAD 
MANAGE 
DISPOSE OF 
OPERATIONS LAUNCH Bus 
Fa7P VEHICLE 
F47H2 
SITE DISPOSE OF SEPARATE 
LOGISTICS FAIRING PAYLOAD 
F47Q Fa7J 


DESTRUCT 
LAUNCH 
VEHICLE 


F47HS 


DISPOSE OF 
UPPER 
STAGE 


RECYCLE | [F47H) | bind | TRANSPORT 
DESTACKED END ITEMS 


ENN ITEMS 
F47R 


Fa7L 
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PAYLOAD 
OPERATIONS 


SYSTEM 
INSTALLED 
AND RFANY 


LOGISTICS 
SUPPORT 
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Use System Decomposition 


RE-ENTER 
TRAINING 
MISSION 
F477 


TRAINER 
FUNCTIONS 


F476 


ACCOMPLISH TURN-UP, 


PREFLIGHT [fm TAXI, AND | MISSION 
TAKFOFE 
F4732 F4733 F734 


MOTION 
FUNCTIONS 


F475 


VISUAL 
FUNCTIONS 


F474 
START-UP 


F472 


MAINTAIN 
SYSTEM 
RFANINESS 

Fa7A 
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Pilot Training Simulator 


LANDING, 
TAX! AND 
SHIITNOWN 

F4735 
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MODIFICATION 
OR 


NISPNSAI 


LOGISTICS 
SUPPORT 


Deriving Performance Requirements 


3.2.1.1 Aircraft shall be capable of flight 
at an airspeed > 700 knots. 


Airspeed > 


Position 
error < 
200 Feet 


3.2.1.2 Position error at an end of leg 
shall be less than or equal to 200 
feet in along track and cross 
track directions. 
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The End of Functional Decomposition 
In the a See Structure 


Lowest tier in all branches 


@ Buy it at that level 
@ Will surrender to design by one of your design teams 
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Alternative Functional Models 
IDEF-8 Diagram 


CREW REPORT CONTROL | 


OUTPUT 
p| ACTIVITY 
INPUT 


AIR FORCE 
TECHNICAL ORDERS 


RETURNED V 


AIRCRAFT AIRCRAFT 
—— | POST FLIGHT 
INSPECTION 


SERVICINGNEEDS ——; 


—REPAIRNEEDS — A 
———_— | | MECHANISM 


AA AIRCRAFT 


aEPORE GENERIC IDEF BLOCK 


REFURBISH- 


v REPORTS 


_—_> 
p| AIRCRAFT — 
SERVICING 
FLIGHT-READY 
AIRCRAFT 
UNIT I 
MAINTENANCE 
PERSONNEL 
SUPPORT 
EQUIPMENT 
& FACILITIES 
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Alternative Functional Models 
Behavioral Diagramming From RDD-100 


From a mainframe software 
model called Hierarchical Input 
Process Output (HIPO) model. 
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Alternative Functional Models 
Enhanced Functional Flow Block Diagramming 
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Timeline Diagramming 


Assume for the moment that we have this functional 
flow diagram. How might we depict the timing 
requirements for these functions? 


F112 F114 F115 F116 PTy7 F118 


bene 
es .. ae | F11C F11B 
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Timeline Diagramming 


FUNCTION TIME AXIS a 


STORE ITEM 


ELASTIC POINT 


Tabular Time Line Alternative 
Probabalistic (mean and variance) 
Simple table structure 


| 
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Alternative Functional Models 
Hierarchical Functional Analysis 


KILL 
Top Level Functional aE ENTRY 


Hierarchy Diagram VEHICLES 


TARGET 
NAVIGATION SURVEILLANCE SELECTION/ TARGET TARGET 
ACCEPTANCE PURSUIT INTERCEPT 
F1 F2 F3 FA FS 


TARGET Second Level Functional 
ES / Hierarchy oe 


PROPULSION TARGET NAVIGATION GUIDANCE 
TRACK 
F41 F42 F43 F44 


FURTHER 


BREAKDOWNS | 
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F4712| Fit to target 
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Traditional RAS 


PERFORMANCE PRODUCT ENTITY 


REQUIREMENTS 


Airspeed > 700 knots Flight vehicle 
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Function-Entity Matrix 
(Traditional RAS) 


FUNCTION F A11 A14 
(THE NEED) ___> PRODUCT ENTITY 
ALLOCATED TO AXIS 
ENTITYA 
(THE SYSTEM) 
F4712 
— PERFORMANCE 
REQUIREMENTS 
F4713 
FUNCTION- 
ENTITY 
SDD MATRIX (RED) 
APPENDIX 
A 
FUNCTION AXIS 
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RAS-Coordinated N-Square Diagram 


TY 


INTERNAL 
INTERFACE 


MATRIX INTERFACE 1115 


PRODUCT ENTITY 
AXIS 
F4712 
PERFORMANCE 
F4713 REQUIREMENTS 


FUNCTION- 
ENTITY 


FUNCTION AXIS MATRIX 
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External 
Interface Definition 


INTERNAL INTERFACE 
MATRIX 


SYSTEM 
RELATIONS 
MATRIX 


EXTERNAL 
INTERFACE 


MATRIX INTERFACE 1212 


ENTITY 
AXIS 


EXTERNAL 
ENTITIES 


AXIS 
PERFORMANCE 
REQUIREMENTS 
SDD 
APPENDIX 
D 
FUNCTION 
AXIS 
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Specialty Engineering Scoping Matrix 


PRODUCT ENTITIES 


. BREE 
= _ 
eo Lhe | xt Xt MID | REQUIREMENT | ENTITY 
le specialty ENTITY | 
=a | He saedcinalas : 
co Pa *) | | MODELING 
Ze APPROACH 
s [= [_ 
: 
Te [ 
a. Specialty Engineering Scoping Matrix b. Requirements Analysis Sheet (RAS) 
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Specialty Engineering Allocation 
SPECIALTY DISCIPLINE H7 ALLOCATED TO ENTITY A11 


INTERNAL INTERFACE 
MATRIX (GREEN) 


PRODUCT ENTITY 
AXIS 


ENTITY-SPECIALTY 
ENGINEERING 
MATRIX (ORANGE) 


FUNCTION- 
ENTITY 
MATRIX (RED) 


FUNCTION AXIS 


H7 
SPECIALTY ENGINEERING 
DISCIPLINE AXIS 
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System Environmental Classes 


ENVIRONMENT 
Q 


COOPERATIVE SELF-INDUCED NATURAL NON- HAZARDOUS SOFTWARE 
ENVIRONMENT ENVIRONMENT ENVIRONMENT COOPERATIVE ENVIRONMENT ENVIIRONMENT 
ENVI RONMENT 


12C Qi QH Qs 


DEVELOPED 
AS AN NATURAL 


EXTERNAL STRESSES 
INTERFACE QN1 
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Three-Tier Environmental 
Requirements Construct 


ENVIRON- 
TA\LORING 


STANDARDS EXERCISE 


FUNCTIONAL 
ANALYSIS 


PRODUCT ENTITY 
SYNTHESIS 


PHYSICAL PROCESS 
FUNCTIONAL ANALYSIS SYNTHESIS 


AND ALLOCATION 
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THREE-DIMENSIONAL 
SERVICE USE PROFILE 


UY 

ENVIRONMENTAL VY 

EQUIREMENTS YY 
Yj 


MM 
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MAP COMPONENTS 
TO END ITEM ZONES 


COMPONENT @) 


ENVIRONEMNTAL 
REQUIREMENTS 
ANALYSIS 
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REQUIREMENTS 
FOR 
SPECIFICATIONS 


RAS Complete 


ENVIRONMENT AXIS 


ENVIRONMENT SUBSETS 


NATURAL 
NON-COOPERATIVE 


ENTITY- 
ENVIRONMENT 
MATRIX (YELLOW) 


HOSTILE 
SEL-INDUCED EXTERNAL INTERFACE MATRIX 
ae SYSTEM RELATIONS 
ENTITY- MATRIX (GREEN) 

PROCESS 


MATRIX (PURPLE) INTERNAL INTERFACE MATRIX 


PROCESS-ENVIRONMENT ENTITY AXIS 


AXIS (BLUE) 
FUNCTION- 
COOPERATIVE ENTITY 
ENVIRONMENT AXIS MATRIX (RED) 


(EXTERNAL INTEFACE) 
FUNCTION AXIS 


SPECIALTY 
ENGINEERING ENTITY SPECIALTY 
DISCIPLINES L ENGINEERING 
MATRIX (ORANGE) 
SPECIALTY 
ENGINEERING AXIS 
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Traditional Structured Analysis 
Overview 


Understand User Requirements 


3.1.3 
(2))Decomposition 


(3 Functional Flow Diagram 
@ oe 3.2 Capabilities 
eremanee 3.3 Interfaces 


Cycle to Requirements 


Lower Analysis 3.4 Specialty Engineering 


3.5 Environmental 
Specifications 


Specailty 
Engineering 
Requirements 


Interface 


3.1.6 Requirements Analysis Sheet Requirements 


Specialty Environmental 


Engineering Requirements Product 
G ) Entity 


Requirements 
Analysig__—Aec = SB Eas Structure 


Three Layerd 
nvironmenta N-Square Diagram 


Requirements 
Analysis 


3.1.4 


VERSION 12.0 2282A2- 32 © JOG System Engineering 


RAS-Complete, Fed From All Sources 


SELECTED 
TEMPLATE 
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RAS-Complete In Table Form 


MODEL ENTITY REQUIREMENT ENTITY PRODUCT ENTITY DOCUMENT ENTITY 
MID MODEL ENTITY NAME RID REQUIREMENT PID ITEM NAME PARA TITLE 
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Specification Generator and Modeling 
Work Product Capture 


TEMPLATE 


DOMAINS MAP PUBLISH 
~~_.| METHODS 
SPECIFI- | SPECIFI- 
AND palatal CATIONS | CATIONS 
METHODS | pomAINS MENTS 


TO ANALYSIS 


TEMPLATE (RAS & 
DATABASE) 


PREPARE SYSTEM 
SAR TEMPLATE SAR ARCHITECTURE 
REPORT 


(Models Capture) 
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VERSION 12.0 


Derive Requirements 
From the TSA Model 


2282A2- 


REQUIREMENTS 

Modeling 

Need 

User Requirements 

Traditional Structured Modeling 
Product Entity Modeling 

Interface Modeling 

Specialty Engineering Modeling 
Environmental Classes and Modeling 
Capabilities 

Interface Requirements 

Specialty Engineering Requirements 
Environmental Requirements 


© JOG System Engineering 


SAR Organization 


DOCUMENT BODY 


System 
Definition APPENDIX A, SYSTEM FUNCTIONALITY 


Document 
APPENDIX B, SYSTEM ENVINROMENT 


APPENDIX C, PRODUCT ENTITY 
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SAR Organization For 
Traditional Structured Analysis 


ITEM PERFORMANCE SELECTED 
SPECIFICATION 


F REQUIREMENTS ANALYSE 
DEFINITION MPLATES 


MISSIONS AND 
FUNCTIONAL PERFORMANCE 
ANALYSIS & REQUIREMENTS 
ALLOCATION DEFINITION PROGRAM 
z} SPECIFICATION 
STE! FORMATTING AND 
Ment PUBLICATION 


TIME AND APPENDIX A = REQUIREMENTS 
SPACE DEFINITION 


ANALYSIS 


SPECIFICATION 
a] ANALYSIS APPENDIX B TREE 
DEVELOPMENT 


MIL-STD-961D 


ARCHITECTURE APPENDIX C INTERFACE 
SYSTEM 


SYNTHESIS REQUIREMENTS 
DEFINITION 
ora APPENDIXD MIL-STD-961D 
ANALYSIS ENVIRONMENTAL ora 
Pp I ) REQUIREMENTS 
APPENDIXE DEFINITION MIL-STD-961D 
ITEM DETAIL 


SPECIAL 
ASSESSMENT APPENDIXF SPECIALTY 
ENGINEERING 


— - REQUIREMENTS 
DEFINITION 
PROCESS APPENDIX G 


ANALYSIS 
TEM CONSTRAINTS ANALYSIS 


AP =e.UG 
| TRADITIONAL STRUCTURED ANALYSIS PLANE = 
JNIFIED MODELING LANGUAGE ANALYSIS PLANI 
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Extending TSA to Software 


¢ We will not spend a lot of time on this because 
most of us understand how flow charting was 
used in software development 


¢ Buta UADF can clearly be built reflecting how 
modeling was done in the 1950 and 1960s 

¢ The blocks represented computer processing 
required and the directed line segments the 
sequence of processing. 

¢ HIPO extended the diagram latterly to cover data 
flow. 
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JOG SYSTEM ENGINEERING 
GRAND SYSTEMS DEVELOPMENT TRAINING PROGRAM 
TUTORIAL 


UNIVERSAL ARCHITECTURE 
DESCRIPTION FRAMEWORK 


MSA/PSARE OVERVIEW AND 
UADF CONSTRUCT 
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Period Goals 


¢ Review the MSA approach derived from work 
by Yourdon, DeMarco, and others 

¢ Extend the MSA model to the PSARE model 
that deals with control aspects of problem 
space and extends coverage to systems and 
hardware entities. 

¢ Show how PSARE applies to hardware as 
well as software development 
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Computer Software 
Modeling Alternatives 


¢ Process-oriented modeling 


— Miscellaneous early methods 
¢ Flow charting 
¢ HIPO, IPO, behavioral diagrams 
¢ Structure diagram 


— Table normalizing 
— IDEF-1X 
— DoDAF 


¢ Object oriented 
— Early OOA 
— UML 
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Modern Structured Analysis 
Modeling Sequence 


a 7b ——= > 


Scenario 
Context Diagram 


VERSION 12.0 2282A3- 4 © JOG System Engineering 


Modern Structured Analysis 
Context Diagram - The Ultimate DFD 
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Modern Structured Analysis 
A Scenario in the Form of an Event List 


Elevator System Event List 


Passenger issues up summons request. 
Passenger issues down summons request. 
Elevator reaches summoned floor. 

Elevator not available for summons request. 
Elevator becomes available for summons. 
Passenger issues destination request. 
Elevator reaches requested destination. 
Elevator arrives at floor. 

Elevator departs floor. 

Elevator fails to move (goes out of service). 
Elevator returns to normal service. 
Elevator becomes overloaded. 

Elevator load becomes normal. 


1. 
2. 
2 
4. 
2 
6. 
i. 
8. 
go. 


Phrase events from perspective of the environment 


From Yourdon, "Modern Structured Analysis" 
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Modern Structured Analysis 
Environmental Modeling Artifacts 


Bubble 


Variable and 

Constant 

Definition 
SS 


Functional 
Definition 


Data 
Dictionary 


State 
Transition 
Diagram 


Data 
Source & 
Destinations 


Structured 


\ Memory 
Process English Variable, Field 
Spec Text Definition 


(P-spec) 


Entity 
Relation 
Diagram 
(ERD) 


Data 
Relationships 
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Modern Structured Analysis 
Data Flow Diagram 


Distance ——. —— 
Count Mile Count Calibrate 
Parameters 
Trans- 
mission Measure 
Mile 
Drive 
SHAFT Shaft 


ACCELERATION 


SPEED ROTATION 


DISTANCE 
Control Monitor DISPLAYS 
Throttle Status 
Mowe E if START ACCELERATE ONTO 
Mechan- THROTTL L , Driver 
cena STOP ACCELERATE, cORMEND? 
Ism RESUME 


DRIVER 
COMMANDS 
RUNNING 


From Derek Hatley and Imitiaz Pirbhai, "Strategies For Real-Time System Specification", Dorset House, 1988 
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Modern Structured Analysis 
Data Dictionary 


¢ One data dictionary line item for each line or store on each 
DFD 

¢ Name the data item and define it with mathematical 
precision 


REQUIREMENTS (DATA) DICTIONARY 


Name Definition 
ACCELERATION = \Measured vehicle acceleration 
\Units: Miles per hour per second 
ACTIVATE = \Driver's cruse control activate command 
\2 Values: On, Off 


DEFAULT COUNT =\Constant = TBD; Default value of calibrated mile count 
\Units: Dimensionless 


From Hatley, Pirbhai, "Strategies for Real-Time System Specification" 
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Modern Structured Analysis 


Process Specification Examples 


PSPEC 1.1 Measure Motion 
For each pulse of SHAFT ROTATION 


Add 1 to DISTANCE COUNT 
then set: 
DISTANCE = DISTANCE COUNT/MILE COUNT 


At least once per second, measure pulse rate of SHAFT ROTATION 
in pulses per hour, and set: 


SPEED = Pulse Rate/MILE COUNT 


At least once per second, measure rate of change of SHAFT 
ROTATION pulses in pulses per hour, and set: 


ACCELERATION = Rate of change/MILE COUNT 


PSPEC 1.2 Measure Mile 
Each time activated, start counting SHAFT ROTATION pulses 


While LOWER LIMIT < pulse count < UPPER LIMIT 
Set MILE COUNT = pulse count 
Otherwise 


Set MILE COUNT = DEFAULT COUNT 


NOTE: All words in all-caps must be explained in dictionary. 
From Hatley, Pirbhai, Strategies for Real-Time System Specification 
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Entity Relationship Diagram (ERD) 


<> RELATIONSHIP 


| | DATA REQUIREMENT 
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MULTIPLE 
VEHICLES INTERSECTIONS 


2] ROAD 
"1 SENSOR |: 


DETECTS 


TRAFFIC 
MANAGEMENT 
PLANS 


APPLIED 
TO 


‘REPORTS. 
“CONDITION DERIVED 
FROM 
STATUS ! 
<> AREA 
TRAFFIC 
<> CONTROLLER 


GIVES 
CYCLICAL 


DIRECTION 
SIGNALS 
EMERGENCY) 
CURRENT 
SENSOR MONITOR 
CONDITIONS 


DATA 


~| EMERGENC 
VEHICLE 
~| DISPATCHER 
c EXTERNAL 


REPORT 


SERIOUS 


CONDITION 
REGISTERS 
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PSARE 


¢ Extension for MSA to better deal with real time 
control 


¢ Formerly known as Hatley Pirbhai 


¢ PSARE = Process for System Architecture and 
Requirements Engineering 


¢ Also extends MSA into systems work 


¢ PSARE is closest to a universal architecture 
description framework of all existing models 
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PSARE 


Also Includes the Context Diagram 


Sw 
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PSARE Delta 


© DFDs illustrate information, energy, or material processing within the system. 


One DFD for each process at a particular level. 

Lower tier DFDs expand on the information represented by the parent process. 

As a whole, a set of DFDs represent requirements statements at increasing levels of detail. 
Data stores retain information from a flow after the source ceases sending it. 

DFD processes may deal with discrete or continuous data. 


© PSPECs define each process in terms of the relationship between input and output. 


Brief, concise narrative descriptions of the functions of a process at lowest level of decomposition. 
Can contain, text, diagrams, or structured English. 

Represents the requirements of the process and not the design. 

They correlate with the process bubbles on the DFD at the lowest tier. 


CFDs illustrates what the process must do under any given conditions. 
CFD bubbles mirror the DFD structure. 
CFD flows can be shown on one plane using dashed lines 
Data conditions are control signals generated within PSPECs through tests on data. 
Process controls are generated from logic in CSPECs and activate/deactivate DFD processes. 


CSPECs define behavior needed to control the system. 


Control behavior defined in terms of finite state machines (combinatorial or sequential). 
Inputs are control flows from CFDs. 
Outputs are process activators and control flows into CFDs. 


REQUIREMENTS (or Data) DICTIONARY defines all data and control elements. 


One line item for each flow on every DFD and CFD. 
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PSARE Requirements Model 


He CONTROL 
A 


REQUIREMENTS 


CONTEXT DIAGRAM 
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PSARE 


Requirements (Data) Dictionary 


¢ One data dictionary line item for each line or store on each DFD 
¢ Name the data item and precisely define it with mathematical 


precision 


REQUIREMENTS (DATA) DICTIONARY 


Name Definition 


ACCELERATION = __s\Measured vehicle acceleration 
\Units: Miles per hour per second 


ACTIVATE = \Driver's cruse control activate command 
\2 Values: On, Off 


DEFAULT COUNT = \Constant = TBD; Default value of calibrated mile count 
\Units: Dimensionless 


From Hatley, Pirbhai, "Strategies for Real-Time System Specification" 
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Combined DFD/CFD 


Distance 


Count Mile Count Calibrate 
Parameters 
Trans- 
meson Measure 
Mile 
Drive 
SHAFT Shaft 


ACCELERATION 
SPEED 


ROTATION 


Brake 


DISTANCE 
DISPLAYS 


————,,/ Monitor 
Status 


Throttle MONITOR 


COMMANDS Driver 


START ACCELERATE, 
STOP ACCELERATE, 
RESUME 


THROTTLE 


Mechan- 
ism 


DRIVER 
COMMANDS 
RUNNING 


ACTIVATE, 
DEACTIVATE, 
CALIBRATE COMMANDS 


From Derek Hatley and Imitiaz Pirbhai, "Strategies For Real-Time System Specification", Dorset House, 1988 
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PSARE 
Isolated DFD 


Distance ————— ———— ee 
Count Mile Count Calibrate 


Parameters 


ACCELERATION, 
SPEED 


SHAFT 
ROTATION 


DISTANCE 
DISPLAYS ——» 


FUEL QUANTITY 


From Derek Hatley and Imitiaz Pirbhai, "Strategies For Real-Time System Specification, Dorset House", 1988 
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PSARE 


Process Specification Examples 
PSPEC 1.1 Measure Motion 
For each pulse of SHAFT ROTATION 
Add 1 to DISTANCE COUNT then set: 
DISTANCE = DISTANCE COUNT/MILE COUNT 


At least once per second, measure pulse rate of SHAFT ROTATION 
in pulses per hour, and set: 

SPEED = Pulse Rate/MILE COUNT 
At least once per second, measure rate of change of SHAFT 
ROTATION pulses in pulses per hour, and set: 
ACCELERATION = Rate of change/MILE COUNT 


PSPEC 1.2 Measure Mile 
Each time activated, start counting SHAFT ROTATION pulses 


While LOWER LIMIT <pulse count < UPPER LIMIT 
Set MILE COUNT = pulse count 

Otherwise 

Set MILE COUNT = DEFAULT COUNT 


NOTE: All words in all-caps must be explained in dictionary. 


From Hatley, Pirbhai, "Strategies for Real-Time System Specification" 
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PSARE 
Isolated CFD 


Distance : —— 
Count Mile Count Calibrate 
Parameters 
Measure 
. Mile 
TOP GEAR 
BRAKING 


Monitor 
Status 


START ACCELERATE, Pv etien 
STOP ACCELERATE, 
RESUME DRIVER 


ACTIVATE, 
DEACTIVATE, 
CALIBRATE COMMANDS 


RUNNING 


From Derek Hatley and Imitiaz Pirbhai, "Strategies For Real-Time System Specification", Dorset House, 1988 
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PSARE 


C-Specs - Generic Combinational Machine 


Next state is a 
function of current 
conditions 


Process 


Controls Action 
« 


Logic 


Control 
Inputs 


Control 


Characterize action logic with an Outputs 
activation table and the event 
logic with a decision table. 
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PSARE 


CSpec - Generic Sequential Machine 


Next state is a function 
of prior states and 
current conditions 


Process 


Controls Action 
<_ 


Logic Sequential 


Machine 


Control 
Inputs 


Characterize sequential machine with a state Control 
transition diagram, table, or matrix. Outputs 


Characterize action logic with an activation 
table and the event logic with a decision 
table. 
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PSARE 


State Transition Diagram 


we 


STATE DEFINITION 


INTERSECTION 
TRAFFIC 


stare| NS | EW 


RED 


RED 
GREEN 
ORANGE 
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t 


ai ; NORTH 


TRANSITION RULES 


a=Power On 
b=State 1 AND 120t 
c=State 2 AND 10t 


d=State 3 AND 60t 
e=State 4 AND 10t REAL WORLD 


t=timing pulse @ 60Hz SITUATION 


2282A3- 23 © JOG System Engineering 


PSARE 


Decision Table 


Define inputs 

Determine all possible 
values of each input 
Determine output results 
desired for each input 


condition 
- Review for impossible \ GON VGCOREN 


input combinations 
Review for combinations 
that can be grouped 


ONLY FOUR POSSIBLE OUTPUTS: 

Both Pump And Heater Off 

Both Heater And Pump On 

Heater On, Pump Off (May Be Dangerous) 
Heater Off, Pump On 
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PSARE 


Sample System Analysis - The Context Diagram 


NATURAL 
ENVIRONMENT 


FIRE RETARDANT 
SUPPLY OCS 
he SATELLITE =| 47 
oe SERVICE 


WILD FIRE 
FACILITY Riza 'NSURANCE acs 

PROTECTION INDUSTRY 

SYSTEM NEED 


ac4 c 


12 

R129 | GOVT RULES AND Ae 
REGULATIONS 

R 

acs |. ELECTRICAL R12A [FRE FIGHTING 
POWER SUPPLIER SERVICES QCA 


i’, 
ac3 | DEVELOPER =f aio3 ye 
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PSARE 


Sample System Analysis — Context Diagram Expansion 


F 
SYSTEM 
CONTEXT 


BUILDING COLLECT 
QC4) CONTRACTOR R2243 ad ‘AND 
R2241 i aie PROCESS ees 
= = 
Po FE WATER ann 
R2242 eee 


n Rix” f 
. - 1 
‘. rab WATER 


R212 
‘ DISTRICT 
NATURAL ~ 
ENVIRONMENT TTT 
ac? R2274 7 RA 
SATELLITE R22721 
: SELECT SELECTION 
R22722 WERT MEASURE, ~ |. |BASED ON WATER 
ws FIRE AND APPLY DISTRICT LINE 
FIRE FIGHTING | QCA Sonia WATER PRESSURE AND 
SERVICES SViCe SOURCE AVAILABILITY OF 
R224) STORED WATER 


TELEPHONE 
SERVICES 


MEASURE 
RESPONSE 
TIME 


acs \ 


GOVERNMENT 
R229 RULES AND 
REGULATIONS 


R324 


DETECT 
TIME OF 
AVAILABILITY, 


ENTERTAINMENT 


AND NEWS acc R228, 


SERVICES 


FIRE 
RETARDANT | ace 
SUPPLIER 


ac3 R223 


ELECTRICAL 


acs | POWER 
NOTES: (1) INTERIOR SPRAY NOT SHOWN 


(2) FE SHOWN ONLY INFLUENCING F1 
BUT IT APPLIES TO F IN GENERAL. 


SUPPLIER 
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aQc1 


acg 


acs 


PSARE 
Sample System Analysis - Super Bubbles 


F 
SYSTEM 
CONTEXT 


FB WATER STORAGE 


Poe aa ie COLLECT AND CONTROL 
= + =~. at 
a") e a 
“Toaisne s ae 
> WATER ‘ 
SUPPORT ! 
SPRAY RIS 


soa — 7 FIELD 
CENTRAL 


NATURAL Pe 
ENVIRONMENT A 
F Ri 
—— 
SATELLITE 
SERVICE 
SELECT SELECTION 
22722) i MEASURE, BASED ON WATER 
“FIRE AND APPLY DISTRICT LINE 
FIGHTING oe PRESSURE AND 
9 43 SSERVICE SOURCE AVAILABILITY OF 
R224 ad is STORED WATER 


f 
Rla Fa 


TELEPHONE 
SERVICES ae \ 
acs MEASURE \ 
RESPONSE ‘ 


TIME 


DETECT 
TIME OF 
VAILABILITY 


ENTERTAINMENT 
AND NEWS 
SERVICES 


acc 


FIRE 


ae Re: R226 SUPPLIER 


RETARDANT 
STORAGE AND 
SPRAY FIELD 


ELECTRICAL 
acs POWER 


SUPPLIER 
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WATER 
DISTRICT 


GOVERNMENT 
R229. RULES AND 
REGULATIONS 


R228 
NDU: acs 


RETARDANT 


ac1 


aca 


PSARE 
Sample System Analysis - DFD 


SELECT, 
MEASURE AND 
APPLY 
WATER SOURCE 


R1U 


MEASURE 


aaah COLLECT AND 


PROCESS 
WATER 


WATER TO 1 
COLLECT Aas : 


RAIN 
WATER 


PUMP 
STORED 
WATER 


ROUTE 
WATER TO 
COLLECTION 
POINT 


MEASURE 
WATER 
DISTRICT 


CONVEY 
WATER TO 
STORAGE 


CONTROL 
WATER 


DISTRICT 
WATER 


WATER 


ACCEPT AND 
DISPOSE OF 
OVERFLOW 


NOTE: (1) Consider adding a function to permit testing of the filters by running 

R2213 the pump without feeding the spray pattern by returning the water 
to storage while measuring water pressure on both sides of the 
filters. A high pressure indication should be logged for an early 
maintenance response. 

(2) Consider adding a function and relationship that directs the water 
flow from function FD8 onto the facility from the direction of the fire 
rather than from all directions. 

(3) Water used must be measured before the spray pattern rather than 
after. 
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R1M 


PSARE 


Common Product Entity Structure 


WILD FIRE 
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SYSTEM 
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PROCESSOR 


WATER STORAGE 
AND 
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SUPPORT 
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WATER COLLECTION 
AND PROCESSING 
A22 A32 Ai2 A42 
WATER 
DISTRIBUTION AND 
CONTROL 


Al3 


TRAINING 
COURSES 


SERVER 
EQUIPMENT 


A23 A33 


SERVER 
SOFTWARE 


A24 


SENSOR 
FIELD 


A25 
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RETARDANT 
STORAGE AND 
SPRAY FIELD 


AS 


RETARDANT 
FLUID STORAGE 


AS1 


RETARDANT 
FLUID PLUMBING 


A52 


RETARDANT 
FLUID SPRAY 
FIELD 


A53 


RETARDANT 
FLUID SPRAY 
FIELD 


A54 
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PSARE 
The Requirements Dictionary is the RAS 


Specification Content 
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CUSTOMER 
NEED 
STATEMENT 
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PSARE 


Deriving Specification Content 


STAKEHOLDER 
REQUIREMENTS 
DOCUMENTATION 


AD HOC 
REQUIREMENTS 
DEFINITION 


ENVIRONMENTAL 
STANDARDS 


MODELING RESULTS 


3.4.4 


NON-MODELING 
SORCES 


CUSTOMER NEEDS 
ANALYSIS 


SPECIALTY 


DEFINITION DEFINITION 


PROBLEM 
SPACE 
MODELING 
WORK 


ANALYSIS 


PERFORMANCE 
REQUIREMENTS 


MSA/PSARE 
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MANAGE 
SYSTEM 
DEFINITION 


TRACEABILITY 
ANALYSIS 


INTERFACE 
REQUIREMENTS 


ANALYSIS 


ARCHITECTURE 
DESCRIPTION AND 
REQUIREMENTS 


SPECIALTY 
REQUIREMENTS 
ANALYSIS 
ENVIRONMENTAL 
REQUIREMENTS 
ANALYSIS 
VERIFICATION 
REQUIREMENTS 
ANALYSIS 
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Continue Reading About MSA and 
PSARE 


¢ Tom DeMarco, "Structured Analysis and System Specification",1979 


¢ Edward Yourdon and Larry Constantine, "Structured Design", Prentice 
hall, 1979 


¢ Victor Weinberg, "Structured Analysis", Yourdon Press, 1980 
¢ Edward Yourdon, "Modern Structured Analysis", Yourdon Press, 1989 


¢ Derek Hatley, Peter Hruschka, and Imtiaz Pirbhai, Process For System 
Architecture and Requirements Engineering", Dorset House, 2000 
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JOG SYSTEM ENGINEERING 
GRAND SYSTEMS DEVELOPMENT TRAINING PROGRAM 
TUTORIAL 


UNIVERSAL ARCHITECTURE 
DESCRIPTION FRAMEWORK 


UML-SysML OVERVIEW AND 
UADF CONSTRUCT 
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UML-SysML UADF Components 


¢ Hardware Models 


° Computer Software Models 


— Process-oriented analysis 
¢ Flow charting 
¢ Modern Structured Analysis 
« PSARE 


— Data-oriented analysis 
¢ Table normalizing 
¢ IDEF-1X 


— Object-oriented analysis 


¢ Early models 


—D architecture framework 
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Benefits of SysML/UML UADF 


¢ Top-Down 

¢ Respect for Sullivan (dynamic opening) 
¢ Seamless HW/SW switch 

¢ Thoroughly modern 

¢ Well supported by tool companies 
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UML and TSA 
Not Too Far Apart Actually 


UNIFIED MODELING LANGUAGE (UML) 


STATIC REPRESENTATION | DYNAMIC REPRESENTATION 


PHYSICAL BEHAVIORAL FUNCTION- 
FACET FACET AL FACET 


TRADITIONAL STRUCTURED ANALYSIS (TSA) 
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SysML/UML UADF With Common 
Solution Space Models 


sysTou NotD 
STATEMENT 


PREOR WORK 


ENTERPRISE 


APPLICABLE 
COCUMENTS 
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The Diagrams of UML 2.0 


¢ For modeling dynamic parts of the system 
Use case diagram 
¥Y Sequence diagram 
— Timing diagram 
¥ Communication diagram (renamed in 2) 
Y State diagram 
Y Activity diagram 
— Interaction overview diagram (2) 
¢ For modeling static parts of the system 
Y Object and class diagrams 
¥ Component diagram 
Y Deployment diagram 
— Composite structure diagram (2) 
— Package diagram (2) 


\ 


(2) = added in UML 2.0 
¥ Diagrams discussed in tutorial 
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The Diagrams in UML and SysML 


UML-2 Only 


ef 


eeeeeeereretiog 
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SysML Only 


Eki 


Object/Class Diagram 
Component Diagram 
Deployment Diagram 
Communication Diagram 
Interaction Overview Diagram 
Composite Structure Diagram 


Requirement Diagram 
Parametric Diagram 
Block Definition Diagram 
Internal Block Diagram 
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Common Diagrams 
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ed 
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Cen 
coe ee 
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Use Case Diagram 
Activity Diagram 
State Diagram 
Sequence Diagram 
Package Diagram 
Timing Diagram 


SysML Derived 
From UML-2 
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Toward a Universal Model 
Using UML-SysML Modeling Artifacts 


PACKAGE DIAGRAM USE CASE 


INTERACTION OVERVIEW DIAGRAM TIMING DIAGRAM IMIER NAD EROS Spi etolt 


REQUIREMENT DIAGRAM 
THREE LAYER SPECIALTY 


Sve oeeL ENGINEERING PUSH THESE 
ae INTO THE 

~~ — Ras GREEN 

Fi 


IDEF-1X DIAGRAM 
OV-7 


SEQUENCE DIAGRAM 

OV-6¢c 

OvV-10c 

OPERATOR SEQUENCE DIAGRAM 


SCHEMATIC BLOCK DIAGRAM 
N-SQUARE DIAGRAM 
COMMUNICATION DIAGRAM 


SV-3 iS = SV-11 

PRODUCT ENTITY DIAGRAM \N \ \ @ “a DATA DICTIONARY 
COMPONENT DIAGRAM [f | Pe / ie 

DEPLOYMENT DIAGRAM FFBD TT Ae 


COMPOSITE STRUCTURE DIAGRAM EFFBD 
BEHAVIORAL DIAGRAM 


li] P SPEC 


IDEF-0 DIAGRAM Tv-1 SV-6 
ACTIVITY DIAGRAM TV-2 SV-7 
OV-5 OV-1 SVB DFD 
CFD 
SV-4 OV-2 SV-9 
OBJECT/CLASS DIAGRAM OV-3 S\L10b C SPEC 


, BLOCK DEFINITION DIAGRAM 
PARAMETRIC DIAGRAM 


=== UML-SysML Model Combination 
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A Universal Model for the Future? 
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SPECIALTY 
ENGINEERING 
SCOPING MATRIX 


Two Older Inside-Outside 
Views of Systems 


System 
Outerface 


System 
Innerface 


System | 
Crossface 


Environment 


The Traditional Structured Analysis View of a System 


The Modern Structured Analysis View of a System 
The Context Diagram 


Terminator 3 
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Use Cases 
The UML-SysML View of a System 
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Outside Inside / INCLUDE 
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UML-SysML Dynamic Modeling 
Artifacts 


Communication Diagram 


(Excluded From SysML) 


Activity 
Diagram 
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State Diagram 
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Sequence Diagram 


messageFive() 


Time 


Lifeline active Argument List 


Covers messages between entities but can’t handle material or energy 
relationships in UML. Can do in SysML. 
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Communication Diagram 


riceaagetncle4 messageThree() _»3 


messageFive()< 5 


a:Classifier AX1 


messageTwo()> 2 
messageFour()< 4 


¢ Actually identical to sequence diagram content. 
¢ Note used in SysML where it is replaced with 
block diagrams 
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Activity Diagram 


The old flow chart lives! 


Swimlane 1 Swimlane 2 Swimlane 3 


Initialization 


uard expression 1 
ig P ] <> Branch 


ie expression 2] 
[Activity three | three | Activity two | two 
| Activity five | five 

eo) 


2 Completion 
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State Diagram 
For a Bang-Bang Thermal Control System 


Initial State Cm Final State 
tooHot tooCool 


Transition atTemp atTemp 
~~ tooCool 
Cool 
tooHot 
State 
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UML Static Modeling Artifacts 


Organization of the Design Solution 


Replaced by block diagrams in SysML 
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SysML Blocks 


Static Elements of the System 


¢ Internal Block Diagram 

¢ Exposes the internal interactions inside of a 
block 

¢ The interconnecting lines can represent 
relationships as diverse as the glue holding the 
wiper sensor to windshield or an interface 
command channel te eee 2 

¢ Object, component, po L | 
and node used in 
UML - why different? 
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SysML Blocks 


Static Elements of the System 


Block Definition 
Diagram 


<block>> 
Name 
values 


Equivalent Product Entity 
Block Diagram 
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SysML/UML Modeling 


Use Case Analysis Example 


r 
CTAS USER 
7, 
acst Fa 
CTAS DEVICE 
i 
ec32 Fa 
CTAS 
PERIPHERAL 
RELATED jer! F fav 
HARDWARE [> acai oo 
cas —— 
— AS 
EXPANSION 4 R27. 
DEVICE 
ach 7] 
acs Fe 
Ra SMART CTAS INFO 
L UNIT R21 PROVIDER }4—_R285,__| 
acat acae 
acs 


SYSTEM 


}_R26., 


Context Diagram 
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Hierarchical Structure for UML-SysML 
Analysis 


SOFTWARE 


ENTITY A23 A23 Product Entity A23 
C23 Top Level Use Case For A23 
C23(1) Terminator 
C23(11) Base Use Case 


C23(111) Extended Use Case 
C23(1111) Scenario 
C23(11111) Sequence Diagram Used to Analyze C23(1111) 


MASTER 
USE CASE 
C23 


CONTEXT DIAGRAM | | CONTEXT DIAGRAM 
TERMINATOR 4 TERMINATOR 3 
C23(4) C23(3) 


CONTEXT DIAGRAM | | CONTEXT DIAGRAM 


TERMINATOR 1 TERMINATOR 2 SUPPORTING CONSTRUCT 
C23(2) NOT PART OF THE MODEL 


C23(1) 


USE USE USE USE 
CASE C23(14) CASE C23(13) CASE C23(11) CASE C23(12) 


EXTENDED EXTENDED EXTENDED EXTENDED 
USE CASE USE CASE USE CASE USE CASE IF SECOND TIER NEEDED 
C23(114) C23(113) C23(111) C23(112) 


SCENARIO SCENARIO SCENARIO SCENARIO 
C23(1114) C23(1113) C23(1111) C23(1112) 


COMMUNICATION STATE SEQUENCE ACTIVITY COMMUNICATION 
DIAGRAM DIAGRAM DIAGRAM DIAGRAM DIAGRAM NOT IN 
N C23(11114) C23(11113) C23(11111) C23(11112) SysML 
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SysML/UML Modeling 
Dynamic Modeling Artifacts Example 
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UML- SysML Cyclical Analysis 


SYSTEM 
A 
so [E 
ENTITY 
AX 
NODE NODE NODE 
AX1 AX2 AS 
Cc ENT| |COMPONENT// |COMPONENT 
ASS AX3 AXB2 
CLASS 
AX311 
OBJECT 
AX3111 


a. Product System Static Hierarchy (Structural Classifiers) 


. Node AX3 Acivity Diagram 


IMPONENT AX31 
| 


COMPONENT AX32 
| 


L2Z1 
Lz2 


Z3 


LZ4 


OKMIPONENT 


Axe —7| COMPONENT 
AX33 


c. Node AX3 Sequence Diagram 


d. Node AX3 State Diagram 
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e. Node AX3 Communication Diagram 
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Entity Identification Using UML-SysML 


Use Cases 


Scenarios Activities 


Context 
Diagram 


Borrowed From pies 
MSA 
Swim lanes 1 2 3 
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UML-SysML Dynamic Modeling 
Overview 


<q—_“Cycle to Lower Tiers @) 


G) Context Diagram 
Dynamic Analysis 
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C4 _ @ State 


| Diagram 


Communication 
erminator Diagram Product Entity 
Structure 
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Top Level Each scenario 
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Each Terminator 
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With Swimlanes 


Possible Extended and/or 
Included Use Cases 


Requirements 
Activity 
Diagram for 


@) a Each Scenario 


Scenario Set 
For Each 
Use Case 
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Combined Product Entity Structure 
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Entity identification flows from sequence, activity, or 
communication diagramming work 
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Possible Software Expansion 
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SPECIALTY ENGINEERING 


DISCIPLINES 


Specialty Engineering Modeling 


Once we know what the entities are we can investigate them 
from a specialty engineering perspective 


PRODUCT ENTITIES These can be software entities too! 


REQUIREMENT | ENTITY 


SPECIALTY 
DISCIPLINE A11 
H7 
MODELING 
APPROACH A12 
A13 
A25 


a. Specialty Engineering Scoping Matrix b. Requirements Analysis Sheet (RAS) 
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Environmental Modelin 
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Standards Selection Service Use End Item 
and Tailoring Profile Zoning 
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Computer Software Environmental 
Factors 


¢ Language 

¢ Compiler 

¢ Machine Structure 
¢ Memory 

¢ Clock Speed 
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JOG SYSTEM ENGINEERING 
GRAND SYSTEMS DEVELOPMENT TRAINING PROGRAM 
TUTORIAL 


UNIVERSAL ARCHITECTURE 
DESCRIPTION FRAMEWORK 


THE FUTURE 


What Will the Future Look Like? 


A single model for the problem space - no matter the 
specific product - will be developed in hardware or software 
Requirements embedded in problem space models 
encouraging requirements compliance in design models 
with the specifications appearing in the form of models 

A connected series of models for design 

Inter-model effects observable directly rather than 
individual human interpretation of effects followed by 
conversation and action - can we do this? 

Verification linkage through models 

Eventual connection between the problem space modeling 
and CAD-CAM models. 

A business process model coordinated with engineering 
modeling 
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Model-Driven Challenges 


¢ Will it be possible for managers to avoid whiplash 
due to the speed of the analytical process? 


¢ Can we provide adequate exposure of the on- 
going and dynamic modeling work to encourage 
sound management of the development process? 

¢ Will it really be possible to build models that fully 
express the problem space essential 
characteristics (requirements) while permitting a 
solution space larger than a single solution? 
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The Computer Network Becomes a 
Team Member in Good Standing 


Will there be room for human 
emotion in the development 
process? | hope so! 
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Development Evolution Timeline, 
Driving Methods Staging 


Rise In the Use 
of Implementable Models 
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Development Evolution Timeline, 
Program Percentages? 
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Our Current Best Toolbox? 
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PERFORMANCE 
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ANALYSIS WORK 
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COMPUTER 
SOFTWARE 
REQUIREMENTS 
ANALYSIS 
oarasane use case 
USE CASE WORK 
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SPECIFICATIONS 


Specification Generator 
The Same Machinery Used for TSA 


SPECIFICATION 
TEMPLATE 
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(Models Capture) 
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Three Ways to Capture the Modeling 


¢ Within specification paragraph 3.1.3 


¢ In asystem architecture report (SAR) referenced 
in paragraph 3.1.3 


¢ Within the computer tool used to accomplish the 
modeling work with a reference in paragraph 3.1.3 
to the tool content 
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SAR Organization For UML-SysML 
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MODELING 
ANALYSIS 


SYSTEM 
STATIC 
MODELING 
ANALYSIS 


VERSION 12.0 


USE CASES 
APPENDIX G 


ACTIVITY 
DIAGRAMS 
APPENDIX H 


STATECHARTS 
APPENDIX | 


SEQUENCE 
DIAGRAMS 
APPENDIXJ 


COLLABORATION 
DIAGRAMS 
APPENDIX K 


CLASS/OBJECT 
APPENDIXL 


COMPONENT 
DIAGRAMS 
APPENDIX M 


DEPLOYMENT 
DIAGRAMS 


AP’ 1 
SYSTEM tee da 


DEFINITION 
DOCUMENT 


2282A5- 11 


ITEM 
REQUIREMENTS 
ANALYSIS 


CAPABILITY 
REQUIREMENTS 
ANALYSIS 
(PARAGRAPH 3.2) 


INTERNAL DATA 
REQUIREMENTS 
ANALYSIS 
(PARAGRAPH 3.5) 


EXTERNAL 
INTERFACE 
REQUIREMENTS 
ANALYSIS 
(PARAGRAPH 3.3) 


INTERNAL 
INTERACE 
REQUIREMENTS 
ANALYSIS 
(PARAGRAPH 3.4) 


SELECTED 
PECIFICATION 
TEMPLATES 


SOFTWARE 
REQUIREMENT 
SPECIFICATION 
EIA-J-STO-016 
PERFORMANCE 
TEMPLATE 


SOFTWARE 
PRODUCT 
SPECIFICATION 
EIA-J-STD-016 
TEMPLATE 


INTERFACE 
REQUIREMENTS 
SPECIFICATION 
EIA-J-STD-016 
TEMPLATE 


UNIFIED MODEING LANGUAGE 


© JG System Engineering 


Combined RAS 


We need a set of MID codes that we can use to couple 
modeling structures to requirements derived from them. 


MODEL ENTITY REQUIREMENT ENTITY PRODUCT ENTITY DOCUMENT ENTITY 
MID MODEL ENTITY NAME RID REQUIREMENT PID ITEM NAME PARA TITLE 

:] Use System A Product System 
Deployment Ship Operations A Product System 
Store Array Operationally XR67 Storage Volume <10!SO Vans Aji Sensor Subsystem 
Specialty Engineering Disciplines A Product System 
Reliability EW34 Failure Rate < 10 x 10-6 Ai Sensor Subsystem 3.1.5 Reliability 
Reliability RG31_ Failure Rate < 3 x 10-6 Ait Cable 3.1.5 Reliability 
Reliability FYH4 Failure Rate < 5 x 10-6 Ai2 Sensor Element 3.1.5 Reliability 
Reliability G8R4 Failure Rate < 2 x 10-6 A13 Pressure Vessel 3.1.5 Reliability 
Maintainability 6GHU Mean Time to Repair<0.2 Hours At Sensor Subsystem 3.1.6 Maintainability 
Maintainability U9R4 Mean Time to Repair<0.4 Hours A111 Cable 3.1.6 Maintainability 
Maintainability J897 Mean Time to Repair<0.2 Hours A12 Sensor Element 3.1.6 Maintainability 
Maintainability 9D7H Mean Time to Repair <0.1 Hours A13 Pressure Vessel 3.1.6 Maintainability 
System Interface A Product System 
Internal Interface A Product System 
Sensor Subsystem Innerface Al 
Aggregate Signal Feed Source E37H Aggregate Signal Feed Source Al Sensor Subsystem 
Impedance Impedance= 52 ohms + 2 ohms 
Aggregate Signal Feed Load E37! Aggregate Signal Feed Load A4 Analysis and Reporting 
Impedance Impedance= 52 ohms + 2 ohms Subsystem 
System External Interface A Product System 
System Environment A Product System 
Hostile Environment A Product System 
Self-Induced Environmental A Product System 
Stresses 
Natural Environment A Product System 
Temperature 6D74 -40 degrees F< Temperature A Product System 

< +140 degrees F 

Non-Cooperative Environmental A Product System 


‘| Stresses 
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UML Model/SRS Template Correlation 
If You Must Use MIL-STD-498/EIA J STD-016 


3 Requirements 
3.1 Required States and Modes 
UML/SysML 3.2 CSCI Capability Requirements 
REQUIREMENTS = 
ANALYSIS 3.2.x (CSCI Capability) 
3.3 CSCI External Interface Requirements 
DYNAMIC MODELS]| © 3.3.1 Interface Identification and Diagram 
UML — 3.3.x (Project Unique Interface Identifier) 
REQUIREMENTS 3.4 CSCI Internal Interface Requirements 
ANALYSIS 3.5 CSCI Internal Data Requirements 
STATIC MODELS 3.6 Adaptation Requirements 
UML ; 3.7 Safety Requirements 
REQUIREMENTS fl 3.8 Security and Privacy Requirements 
ANALYSIS 3.9 CSCI Environment Requirements 
3.10 Computer Resource Requirements 
SPECIALTY 3.10.1 Computer Hardware Requirements 
ENGINEERING A e i 


3.10.2 Computer Hardware Resource Utilization Requirements 
REQUIREMENTS S 3.10.3 Computer Software Requirements 
BNA S< 3.10.4 Computer Communications Requirements 
3.11 Software Quality Factors 

ENVIRONMENTAL |_ g 3.12 Design and Implementation Constraints 
REQUIREMENTS 3.13 Personnel-Related Requirements 
ANALYSIS 3.14 Training-Related Requirements 

3.15 Logistics-Related Requirements 

3.16 Other Requirements 

Sally” Packaging Requirements 

3.18 Precedence and Criticality of Requirements 


ip. 
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Model Results Flow Into Specifications 
Content Through the RAS 


Universal Specification 


Problem Space Models 
Scope 


References 
Context Diagram Requirements 
3.1 Requirements Derivation Sources 
Use Case 3.1.1 | Non-Modeling Sources 


Sequence Diagram 3.1.2 Problem Space Modeling 


Activity Diagram 3.1.3. Solution Space Modeling 


3.1.3.1 Product Entity Modeling 
State Diagram 3.1.3.2 Interface Modeling 
3.1.3.3 Specialty Engineering 
Modeling 
Solution 3.1.3.4 Environmental Modeling 


Space Models 3.2 Capabilities 


3.3 Interfaces 

3.4 Specialty Engineering 

4.5 Environmental 
Verification 
Packaging and Shipping 
Notes 
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Universal Architecture Description 
Framework Approach 


Allocate 
Model the Problem Space Requirements 


Annotating Artifacts With MID | . 


Published 
Specifications 


SPECIFICATION 


Verification | 


List Artifacts in RAS in 
MID Alphanumeric Order 


Derive Employ Universal 


Format For Entity 
Specification 
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Building Universal Specifications 


USER 
CUSTOMER || REQUIREMENTS ENVIRONMENTAL 


NEED STANDARDS 
STATEMENT DOCUMENTATION 


ROGRAM MODELING AND 
EQUIREMENTS ANALYSIS 


DYNAMIC INTERFACE 
DEFINITION DEFINITION 
TY H 


PROBLEM 
SPACE 
MODELING 
WORK 


PERFORMANCE 
REQUIREMENTS 
ANALYSIS 
INTERFACE 
REQUIREMENTS 
ANALYSIS 
SPECIALTY 
REQUIREMENTS 
ANALYSIS 
ENVIRONMENTAL 
REQUIREMENTS 
ANALYSIS 
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It Fits Into a Grander Structure 


| 
bd | 
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Model Convergence On the Road to 
Enterprise Architecting 


BPDM = Business Process Data Model 
CWM = 
UPDM = Unified Profile For DODAF MoDAF 
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Action Items For Youasa 
System Engineer 


¢ Continue your studies of requirements work 

¢ Come to an understanding about UML and SysML 

¢ Within your companies and programs develop 
modeling skills and work toward simplifying your 
combined set of models into a universal 
framework 

¢ Work toward correlating the SW and HW 
development work patterns so as to encourage 
more effective integration 

¢ Join INCOSE/NDIA working groups that deal with 
the issues covered in this tutorial and offer your 
ideas. 
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Tasks For a Development Organization 


¢ Select a set of models for your VADF 


¢ Train your people to apply those models to problem 
space 


¢ Perfect inter-model traceability and integration 
skills as well as coordination of modeling and 
concept development work 


¢ Insist on requirements being derived from models 
¢ Apply a universal specification format 


¢ Capture the work products that result from 
modeling work in a configuration manageable form 


¢ Get on the tools treadmill 
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The Seven Fundamentals of Mentoring 


Nicholas M. Torelli 


Systems Engineering Directorate 
Office of the Director, Defense Research and 
Engineering 
13th Annual NDIA Systems Engineering Conference 
October 25, 2010 
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1 


Oct 2010 Page- DISTRIBUTION STATEMENT A -- Cleared for public release by OSR on 20 October 2010 -- SR case number 11-S-0069 applies. 


Part I: Background 


Definition and Background 

Why We Need It 

Successful Mentoring 
Characteristics of a Good Mentor 
Benefits of Mentoring 

Protégés 

Mentoring Models 

Mentoring Relationships 

Tips for Mentoring 


Break 
Part II: Seven Fundamentals of Mentoring 


13" Annual NDIA SE Conf 


Mentoring Takes Place Outside of a Manager-Employee Relationship 
Mentoring is Career Focused 

Mentoring Relationships are Personal and Confidential 

Mentoring Relationships Cross Job Boundaries 

Mentoring Identifies Unique Skills and Abilities 

Mentoring Provides Insight Into the Workings of the Organization 
Mentoring Communicates Organizational and Professional Values 
Poor Mentoring Practices 

Summary 
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DoD Systems Engineering 
Workforce 


Recruit: 
Highly Develop / Train: 
Qualified Mentors 


Experts 


Develop / Train 


and Retain “4 


Oo 
IN 
VY) 
oO 
O 
—_ 
O 
— 
a 
—_ 
= 


Recruit: 
Journeymen 
Retired Military 
SE FFRDCs 


Recruit: 
Interns 


25-35 35-45 45-55 >55 
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Background: DoD SE Acquisition 
Workforce 


- Legislation And Policy Direction 
Current DoD Efforts 


- Systems Engineering - The Best Job in 
America? 


DISTRIBUTION STATEMENT A -- Cleared for public release by OSR on 20 October 2010 -- SR case number 11-S-0069 applies. 


Workforce Development 
Legislation and Policy 


- National Defense Authorization Act For FY 


2006 (NDAA FY06): Human Capital Strategic 
Plan 


- NDAA FYO8: Section 852, DoD Acquisition 
Workforce Development Fund 


- NDAA FY09: Weapon Systems Acquisition 
Reform Act 


- 2010 SECDEF and USD(ATA&L) Efficiency 
Initiatives 


Best Jobs in 
America 


Sales Director 


Sales and Marketing (97,000) * 
$140,000 | $239,000 - 


Attorney/Lawyer 


Legal (541,000) 


Business Analyst, IT - 
1T (125,000) r 
$82,600 | $119,000 - 
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$115,000 | $262,000 - 
> $150,000 | $228,000 - 


IT Project Manager 
1T (174,000) 
$98,700 | $140,000 


Anesthesiologist 
Healthcare (23,000) 


$292,000 | $408,000 - 


Physician/General 
Practice 
Healthcare (90,000) 


Telecommunications 
Network Engineer 
fT (21,000) 
$86,200 | $130,000 


in America? 


Information Technology (88,000) 


Physician Assistant 
Healthcare (82,000) 


$90,900 | $124,000 - 


Certified Public 
Accountant 
Financial (189,000) 


- $74,200 | $138,000 : 


Software Developer - 


IT (796,000) 
$79,400 | $116,000 


Human Resources 
Manager 
Other (226,000) 


$71,800 | $111,000 - 


Securities Trader 
Financial (17,000) 


> $113,000 | $491,000 : 
: $77,800 | $157,000 


Source: http://www.focus.com/ 


Systems Engineer 


$87,100 | $130,000 


College Professor 
Education (278,000) 
$70,400 | $115,000 


Physical Therapist 
Healthcare (181,000) 


$74,300 | $98,100 


Pharmacist 
Healthcare (198,000) 


: $109,000 | $134,000 - 


Senior Financial 
Analyst 
Financial (127,000) 
$79,900 | $109,000 


Education/Training 
Consultant 
Financial (23,000) 


Nurse Practitioner 
Healthcare (23,000) 
$85,200 | $113,000 


Computer/Network 
Security Consultant 
IT (13,000) 


$99,700 | $152,000 


> Occupational Therapist - 
Healthcare (107,000) 
$69,700 | $100,000 


: Physician/Obstetrician/ - 


Gynecologist 
Healthcare (14,000) 
$222,000 | $338,000 


ne enc woee 
Physiciai 
Healthcare sarily. » 
$249,000 | $386,000 


Systems Engineer - The Best Job 


Intelligence Analyst 
Government (51,000) 


$82,500 | $115,000 


Nurse Anesthetist 
Healthcare (19,000) 


$157,000 | $214,000 


Clinical Psychologist 
Healthcare (57,000) 


$81,100 | $172,000 


Product Management 


Director 


> Sales and Marketing (17,000) 
$145,000 | $201,000 


i/human-resources/best-jobs/_c 2010 Focus - Used with permission. 


Sector (Total Jobs) 
Median salary | Top pay 


$177,000 | $279,000 


ected interest arteas 


highest paid Salary 
highest median Salary 
most flexibility 

most satisfaction 
benefit to society 
highest job growth 
highest low stress 
most security 

future growth 


Job Title 


Software Product 
Manager 
fT (37,000) 


: $106,000 | $148,000 


Psychiatrist 


Healthcare (20,000) 


Veterinarian 
Other (68,000) 
> $83,900 | $157,000 
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Technical workforce development initiatives across government, 
industry and academia: 


- Competency Assessments for technical management career 
fields (‘first look” in Q4 2010) 

- Competency-based certification standards to enable “raising 
the bar” for workforce performance 


- Flexible certification framework to encourage professional 
growth and provide the opportunity for subsequent 
progression to Program Management 


- Expanded collaboration with civilian universities and industry 
associations 
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Mentoring and Why We Need It 


Definition: Professional Mentoring Is Mentoring 
Between An Experienced Person, The Mentor, And A 
Less Experienced One, The Protégé, To Facilitate The 
Development Of The Protégé Professionally 


- The Intent Of The Mentoring Process Is To Facilitate 
The Pace And Quality Of The New Colleague's 
Development Into A Competent Practicing Professional 
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Successful Mentoring 


- The Most Successful Mentorships Are Those That Are 
Built On A Shared Understanding Of Both Parties’ 
Expectations From The Relationship, Positive Feelings 
About One Another, And A Lot Of Optimism About How 
The Relationship Will Benefit Them Both. 

- Mentoring Is:* 

- Opportunity To Learn From Someone Who Has “Lived It" 
- Sharing Experiences And Expertise 
- Support, Encouragement, Guidance, Advice 
- Reciprocal 
- Mentoring Is Not:* 
- A Therapy Or Venting Session 
- A Be-All-End-All Source For Development 
- Manager Replacement 


*Executive Mentoring Program: Executive Briefing Presentation. Dell, Inc. 
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Characteristics of a Good Mentor 


-Willing: Best Practice Indicates That Mentors Should 
Be Willing To Fill The Mentor Role And Not Be 
Pressured Into Mentoring. 


‘Experienced: In General, A Mentor Should Have A 
Proven Track Record Of Positive Effect In The Work 
Environment. 


-Non-Judgmental: A Mentor-Protégé Relationship 
Focuses On Developing The Protégé Professionally And 
Personally. The Protégé Should Feel Free To Discuss 
Issues Openly And Honestly, Without Worrying About 
Negative Consequences On The Job. 


iV VZolt| (om £OLU ME 1 Me WE CLolelo MN W\ anne) ata 
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Characteristics of aGood Mentor Pas 
(cont'd) : 


- Good Communicator: 
- Is Able To Articulate Effective Instructional Strategies 
- Listens Attentively 
- Asks Questions That Prompt Reflection And Understanding 
- Offers Critiques In Positive And Productive Ways 
- Uses E-mail/Social Networking Effectively 
- Efficient With The Use Of Time 
- Conveys Enthusiasm, Passion For Profession 
- Is Discreet And Maintains Confidentiality 


- Professional Competence And Experience 
- Others ? 


~! 
= 
* * 
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Characteristics of a Good Protege 


- Able To Take Constructive Criticism 
- Active Listener 
- Good Communicator 


- Willing To Stretch To Learn And Try New 
Things 
- Willing To Take Risks (Shoot Higher) 


- Be Able To Identify Long And Short Term 
Career Goals 


- Willing To Accept That Those Goals May Change 
- Others ? 
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Benefits of Mentoring for the 
Mentor 

Recruitment And Retention 

Improving Skills And Knowledge 

Learning Goes Both Ways 

Networking 

Helping Someone Succeed 

Personal Satisfaction 
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Benefits of Mentoring for the 
Protege 


- Exposure To Best Practices And Lessons Learned 

- Networking 

- Receiving Critical Feedback In Key Areas: 
- Communications 
- Work Relationships 
- Technical Abilities 
- Change Management And Leadership Skills 

- Acquiring Specific Skills And Knowledge Relevant To 
Personal Goals 

- Better Understanding Of Professional Growth Within 
The Organization 

- Insight Into The Organization's Culture And Unspoken 
Rules 


- Sharing Frustrations And Successes With Someone Who 
Can Empathize With Where You Are In Your Career 
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-Junior colleague 
*Little/no job experience 


-Needs workplace "survival skills 


‘Needs briefings on "internal 
workings" and office politics 


Benefits of Mentoring for the 
Protege 


Polished colleague 
“Extensive job experience 


‘Demonstrates work-place "survival 
skills" 


‘Provides briefings on "internal 
workings" and office politics 


When you enter into a mentoring relationship, you and your protégé become 


professional partners. 
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Benefits of Mentoring for the 
Organization 


Enhances Strategic Mission Initiatives 
Enhances Recruiting and Encourages Retention 


- Reduces Turnover Rates 


- Improves Productivity 
Enhances Professional Development 


- Links Employees With Valuable Knowledge And 
Information With Those Employees In Need Of Such 
Information 


- Creates A Mentoring Culture For Continued Employee 
Growth And Development 


- Provides An Effective Mechanism For Quickly 
Answering Questions Or Concerns 
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° ‘ OM Ae, *» 

The Tennessee Valley Chapter of Women in Defense (TVC WID) is building a dynamic 
Mentor Protégé Program that will provide professional development and networking 
opportunities in support of Women in Defense. The program is being designed in a way that 
recognizes and respects the needs, expectations, and life-demands of professional women and 
those just starting their careers. 


a eer 


One of the essential steps in establishing a viable program is attracting a strong group of 
Mentors to anchor the first Cohort FY11 and we are now accepting brief bio/resumes from 
members who want to serve and are willing to commit to the following: 

eA minimum of 4 hours per month investment per Protégé (maximum of two Protégés allowed 
per Mentor) 

eA one year commitment to the Mentoring Program 

eA desire to grow professionally through Mentor-Protégé relationships 


Please express your interest by submitting a half page summary about yourself to include: 
eName 

¢Current Position 

eBrief Career History (including years of professional experience) 

eLength of Time in Huntsville 

eEducation 

eRelevant Strengths, Skills, and Interests 

Why You Wish to Volunteer to be a Part of the FY11 TVC WID Mentoring Program 


Please include your contact information and email your Bio directly to Paulette Risher at 

AND Kathy Broad at no later than July 25rd. Our first 
year FY11 planning is underway and we are excited about the Mentoring Program being a 
rewarding and fun effort sustained by the diversity and leadership you bring to WID. 


Find People, Jobs, Answers, and More..... 


Mentors Helping Mentees 
Mentees Helping Mentors 


We all learn from each other. The main goal is to 
pair individuals up wth other individuals that can 
coach one another remotely. Please join the other 
site as well at mentormentee.collectivex.com so 
you may use the discussion groups. 


About this Group About this Group 
*Created: June 3, 2008 

*Type: Networking Group 

eMembers: 75 

eSubgroups: 2 

eOwner: 

Managers: 

¢Website: 


Subgroups 


e4 members | 


°1 member | 
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-E-mentoring 


‘Another Model Allows The Mentor To Be A Referral 
Person, Not The Person With All Of The Answers 


-Self - Mentoring 


ASOK, I'M PUTTING 
YOU ON OUR SPECIAL 
SELF-MENTORING 


www.dilbert.com — scottadams®@aolcom 


DILBERT: (c) Scott Adams/Dist. by United Feature Syndicate, Inc. 


‘Traditional Mentor-protégé Relationship 


IF YOU HAVE ANY 
QUESTIONS WHAT- 
SOEVER, FEEL FREE 
TO TALK TO YOUR - 
SELF. 
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ied ‘ sy 
I'M THE MASTER + 
OF NON-MONETARY 


a[aF/e © 2002 United Fasture Syndicate, ine. 


Matching Mentor with Protege 


www.dilbert.com  scottadamedacl.com 
S009 ©2007 Scott Adams, Inc./Dist. by UFS, Inc, 


DILBERT: (c) Scott Adams/Dist. by United Feature Syndicate, Inc. 
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‘Match Mentors And Protégés: Areas To Consider 
Are: 


— The Available And Willing Mentors 
— Mentor And Protégés' Strengths And Weaknesses 
— Learning Styles 


— Goals Of The Organization/Agency Or The Mentor 
Program 


“Matching is, without a doubt, the single most critical success factor to a formal 


corporate mentoring program". - Deb Bauer, Program Managers of Dell's Global 
Diversity Department 
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CNN World News 

August 25th, 2010 

10:20 AM ET 

Mentoring session turns into a shootout 

Two coalition service members, an Afghan police officer and one 
civilian were killed in western Afghanistan on Wednesday when a 
mentoring session turned into a shootout, military officials said. 
Officials with NATO's International Security Assistance Force were 
trying to determine what caused the shooting. 

The shooting apparently happened during a mentoring session between 
coalition soldiers and the Afghan national police, coalition officials 
said ina statement. 

During the mentoring session, an Afghan officer began firing a gun 
and the coalition soldiers returned fire, the statement said. 

The incident, which occurred in the Badghis province, was followed by 
a demonstration by locals in the area, according to the statement. 
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Tips for Mentors 


e The First Session Should Take Place In Person, But 
May Be Conducted By E-mail Or On The Telephone 


A Face-to-Face Meeting Should Be In A Neutral 
Setting Without Distractions Or Interruptions. 


Discuss The Protégé's Expectations. 
- Where Do You Want Your Career To Go? 


- Develop A Meeting Schedule With Your Protégé 


13" Annual NDIA SE Conf 
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Tips for Mentors 


- Listen, Counsel, Coach, Advise On Career And Goal 


Setting To Help Protégé Develop Individual Career 
Development Plan 


- Evaluate Each Meeting With The Protégé 


- Most Mentor Research Describes That 90 Percent Of 


The Mentor-Protégé Relationships Work Out Well 


- When Developing A Mentor Program, The 
Organization/Agency Should Address How A Mentor 
And Protégé Pairing That Is Not Successful Will Be 
Handled 


- Conclude The Mentoring Process When Appropriate 
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MY DREAM IS TO 
SOMEDAY BE LIKE 
YOU. 


www.dilbert.com  scottadarneeaclecom 


DILBERT: (c) Scott Adams/Dist. by United Feature Syndicate, Inc. 
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T HOPE TO ADVANCE 
FROM BEING TOTALLY 
WORTHLESS TO BEING 
TOTALLY WORTHLESS 

AND OVERPAID. 


1 
b20-07 82009 Scott Adana, Inc.,Dket. by UFS, Inc, 


BREAK 


13% Annual NDIA SE Conf 


Oct 2010 Page-25 DISTRIBUTION STATEMENT A -- Cleared for public release by OSR on 20 October 2010 -- SR case number 11-S-0069 applies. 


#1: Mentoring Takes Place 
Outside of a Manager-Employee 
Relationship, at the Mutual 
Consent of Mentor and Protégé. 
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#2: Mentoring is Career-Focused 
or Focuses on Professional 
Development that may be Outside 
a Protégé's Area of Work. 
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Focus on Professional 
Development 


ALICE, IT THOUGHT 
IT WAS TIME FOR 
US TO HAVE ALITTLE 
MENTORING SESSION. 


MAYBE WE CAN SKIP 

| THE PART WHERE I SAY 

YOU NEED TO BE MORE 

CONFIDENT AND SPEAK 
OUT AT MEETINGS. 


MAKE SENSE WHEN 
I’M MORE CAPABLE 
THAN YOU IN EVERY 
IMPORTANT WAY? 


DilberLeom  DilbertCartoonistégmail.cam 


zy] 
| 
i 
Fy 
: 
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#3: The Mentorship Relationship 
is Personal and Confidential; A 
Mentor Provides Both Professional 
and Personal Support. 
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#4: The Mentorship Relationship 
Crosses Job Boundaries. 
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#5: A Mentor Will Identify the 


Protégé's Unique Skills and 
Capabilities and Work With 
Him/Her to Make the Most of 
Those Talents. 
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T NEED 
CAREER 


ADVICE. 


THE SECOND CHOICE 
WILL SQUEEZE THE 
LIFE OUT OF WOU 


LIKE A 
PEACH. 
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Identify the Protege's Unique Skills 


and Capabilities 


Py SHOULD I KEEP MY 
| COMFORTABLE JOB 


z 
i 


YOU CAN'T LJIN. 
50 I RECOMMEND 
THE CHOICE THAT 
KEEPS YOU ALJAY 
FROM HOME MORE. 


VISE ON A 


Si Vom 62d Unde Festure Syrsicate, ine. 


DILBERT: (c) Scott Adams/Dist. by United Feature Syndicate, Inc. 


OR SHOULD I TAKE 

A BETTER JOG WITH 
LONGER HOURS AND 
A HIDEOUS COMMUTE? 


BECAUSE FRANKLY —- 
AND TLL TAY TO SAY 
THIS DELICATELY — 

A LITTLE BIT OF YOU | 
GOES A LONG LAY. 


THE FIRST CHOICE IS 
A SURE PATH TO 
SELF-LOATHING 

AND UNHAPPINESS. 


THATS THE PROBLEM ~ 


| WITH GOOD ADVICE 


NO ONE WANTS TO 
HEAR IT. 
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#6: A Mentor Helps a Protégé 


Better Understand How the 
Organization Works (Those 
Aspects of the Organization that 
Aren't Written Down) 
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##7: A Mentor Should 
Communicate Professional and 
Organizational Values 
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Poor Mentoring Practices 


Canceling Appointments 


Not Providing Opportunities For The 
Protégé To Observe Work In Progress 
Disparaging The Organization/Agency's 
Processes, Procedures, Or Politics 
Mentor Tyranny, Manipulation or 
Politicking 

Bad Protégé Actions 
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Summary 


- Give the Mentor-Protégé Relationship Structure 

- Recruit Carefully 

- Provide Protégé Training & Orientation 

- Define Expectations Up Front 

- Give Feedback 

- Prepare for the End 

- Benefit The Mentor, Protégé And The Organization 


As The Protégé Grows Professionally, The Amount Of Dependence 
Decreases, Until The Protégé Is Shaped Into An Independent And 


Competent Employee. 


3% Annual NDIA SE Conf 
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For Additional Information 


Nic Torelli 


ODDR&E/Systems Engineering 
703-695-2300 | nicholas.torelli@osd.mil 


Elizabeth Birdsall 


SAIC 
703-602-0851 x194 
elizabeth.birdsall.ctr@osd.mil 
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Tutorial Objectives 


¢ Emphasize the importance of identifying and managing program risks and 
issues 


¢ Clarify the difference between risks and issues 


¢ Present Risk/Issue Avoidance 


— The elimination of the sources of high risk by replacing them with a lower-risk 
alternatives 


— The establishment of sound technical, programmatic and management 
practices and activities early and their execution throughout the entire life 
cycle to reduce risks and issues 


¢ Present opportunities associated with risks/issues 
— When perusing new opportunities risks and issues are encountered 
¢ By taking calculated risks organizations may realize future opportunities 


— Opportunities to improve program and project performance may surface while 
resolving risks and issues 
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Where Are We 


¢ Tutorial Objectives 
=> + Introduction 
— Definitions 
¢ Reasons for Risk/Issue Management 
* Opportunities 
e Risk Management 
* Issue Management 
¢ Risk/Issue Avoidance 
¢ Risk/Issue Opportunities 
¢ Opportunity/Risk/Issue/Opportunity Scenario 
* Questions/ Discussion 
e References 
* Contact Information 
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Introduction 


Definitions 


e Risks (IEEE Std 1540-2004; Standard for Software Life Cycle Processes) 
— Program and project risks are the likelihood of an event, hazard, threat, or 
situation occurring and its undesirable consequences 
e Risk (Project Management Body of Knowledge PMBOK) 
— Anuncertain even or condition that, if it occurs, has a positive or negative effect 
on project’s objectives 
e Issues (QATAR National Project Management) 
— Anissue is something currently happening that is having a negative impact on the 
project and requires resolution for the project to proceed successful 
°* Issues 
— Anissue can be associated with a risk if the risk is realized; has occurred 
¢ Opportunity (The American Heritage Dictionary) 
— A favorable or advantageous combination of circumstances 
— Achance for progress or advancement 
¢ Opportunity (PMBOK) 


— Acondition or situation favorable to the project, a positive set of circumstances, a 
positive set of events, a risk that will have a positive impact on project objectives, 
or a possibility for positive chances 
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Introduction 


Definitions 


e Risk Response 


— The process of developing options and actions to enhance 
opportunities and reduce threats to project objectives PMBOK 


— Includes Mitigation and Contingencies 
— Includes acceptance of the risk or issue consequence 


¢ Mitigation 
— Risk mitigation implies an elimination or reduction in the probability 
of risk occurrence PMBOK 


* Contingency 


— Issue contingency implies an elimination or reduction of the impact of 
issues or alternative actions taken 
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Introduction 


¢ We will start with Opportunities and end with Opportunities 
— Opportunity 
— Risk 
— Issue 
— Opportunity 
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Introduction 


Issues 
Opportunity ¢ When risks are realized, occur, 
New weapon system they become issues 
New spacecraft Issues could arise without 
New micro processor being associated with an 
New restaurant identified risk 


Risks 
*When attempting a new invention, 
activity, or project you are taking 
advantage of an opportunity. But there 
is always an element of risk associated 
with these ventures 


Opportunity 
Resolving the risk, or 
correcting the issue, could 
surface opportunities to make 
corrections to keep these 
risks/issues from recurring 
(called process improvement) 


*Managing Risks, Methods for Software Systems Development; Dr. Elaine M. Hall, SEI Series in Software Engineering 


MITRE Al Florence 


Where Are We 


¢ Tutorial Objectives 
¢ Introduction 
= - Reasons for Risk/Issue Management 
* Opportunities 
e Risk Management 
« Issue Management 
° Risk/Issue Avoidance 
¢ Risk/Issue Opportunities 
* Questions/Discussion 
e References 
* Contact Information 
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Reasons for Risk/Issue Management 


¢ When developing, delivering, and acquiring systems and 
products 


developers and acquirers face many challenges 


¢ Challenges can exist with many items and activities: 


Cost 

Schedule 
Technical 
Management 
Programmatic 
Process 
Performance 
Others? 
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Reasons for Risk/Issue Management 


¢ Consequences may be numerous if challenges are not mitigated 


Cost overruns 

Late deliveries 
Technically inadequate 
Programmatic difficulties 
lrate management 

lrate customer 

Canceled project 

Loss of market share 
Missed opportunities 
Others? 
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Reasons for Risk/Issue Management 


¢ There are solutions for an organization to help mitigate these 
challenges 
— Proper program/project management 
— Proper program/project planning 
— Program/project monitoring and control 
— Adequate budgets 
— Adequate schedules 
— Proper requirements development and management 
— Contract tracking and oversight 
— Product evaluation 
— Performance management 
— Risk/Issue management 
— Quality assurance 
— Configuration management 
— Independent Verification and Validation (IV&V) 
— Others? 
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Reasons for Risk/Issue Management 


¢ |Itis important to recognize risks and issues early and manage 
them to reduce or eliminate their impact if they occur 


¢ Often organizations neglect risk and issue management or do 
not provide sufficient attention to them 
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Compliance with CMMI © 


¢ Software Engineering Institute (SEI) Capability Maturity 
Model Integration (CMMI) 
CMMI for Development v1.2 All have 
CMMI for Acquisition v1.2 Risk Management and 
*Issue Management 
CMMI for Service v1.2 peacace Wr eac 
V1.3 release soon for all 


In order for organizations to be compliant with CMMI they need to 


establish risk and issue management capabilities 


* Issue management is implied in the Project Planning, Project Monitoring and 
Control, Quality Assurance and Configuration Management 
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Where Are We 


Tutorial Objectives 
Introduction 

Reasons for Risk/Issue Management 
Opportunities 

Risk Management 

Issue Management 
Risk/Issue Avoidance 
Risk/Issue Opportunities 
Questions/ Discussion 
References 

Contact Information 
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Take Advantage of Opportunities 


e Risks are not always undesirable events 
— Taking risks can sometimes be necessary 


— If we are not willing to take calculated risks our advancement in 
technology and business may be hindered 


¢ We have to be circumspect with the risks we are willing to 
take 
— And MANAGE them properly 
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Take Advantage of Opportunities 


Opportunities/Risks 


*Running away from risk is a no-win strategy. Unless your 
organization has been sound asleep for the past 30 years, 
all the relatively risk-free opportunities have long since 
been exploited. The remaining high-opportunity areas 
are rife with risk. It is in these areas and these alone 
where you need to focus your attention, skills and 
resources. 


*Managing Risks, Methods for Software Systems Development; Dr. Elaine M. Hall, 


SEI Series in Software Engineering 
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Opportunity 


CED An opportunity to get an to an ice cream stand across the tracks 
aX 


Railroad 
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Where Are We 


Tutorial Objectives 
Introduction 

Reasons for Risk/Issue Management 
Opportunities 

Risk Management 

Issue Management 
Risk/Issue Avoidance 
Risk/Issue Opportunities 
Questions/ Discussion 
References 

Contact Information 
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Risk Management Process 


e Risk Management is an overarching process that encompasses 
Risk Planning 

Risk Identification 

Risk Analysis 

Risk Response 

Risk Monitoring and Control 


PMBOK 
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Risk Management Flow 


Identify & 
Submit Risk 


Initial 
Acceptance 


Transfer or 
Escalate 


Transfer 
Escalate 


Risk Still 
Valid 


Conduct 
Risk 
Analysis 


Mitigation 
Strategies 
Required 


Reject Risk 
Close Risk 
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Develop 


Mitigation 
Strategies 


Continuous Monitor and Control Risk 


Close Risk 


Yes 


Has 


Has 


; No Risk Occurred Yes 
Risk Been > ; 
- or is 
Mitigated ; 
Imminent to 


Occur 


Execute 
Mitigation 
Strategies 


Go to Issue 
Management 
Flow 


Develop 
Contingency 


Strategies Do 


Contingency 
Strategies 
Exist 


Yes 


Yes 


Contingency 
Strategies 
equired 


No 


No 
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Risk Management Planning 


¢ Risk management planning is the process of deciding how to 
approach and conduct the risk management activities for a project 
e Planning is important to 


— Ensure the level, type and visibility of risk management are commensurate 
with both the risk and importance of the project to the organization 


— Provide sufficient resources and time for risk management activities 
— Establish an agreed-upon basis for evaluating risks 


e Risk planning should be completed early during project planning 


PMBOK 
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Risk Management Team 


¢ The Risk Managment planning activity may assign a Risk 
Management Team to administer the Risk Management Program 

e A Risk Manager may be assigned to manage the Risk Management 
Team 


e A Risk Management Board may be chartered to review, accept, 
decline, transfer and escalate risks 


¢ Hierarchy Governance Boards may exist for escalation of risks based 
on thresholds 


¢ Everyone on the program/project is responsible for risk 
management 


The level of this implementation depends on the size, scope, 


critically, safety, security, etc. of the application 
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Risk Management Plan 


e Risk management planning needs to be part of project planning 


e Arisk management plan can be a stand alone plan or part of the project 
plan 

¢ The risk management plan needs to be tailored to the scope of the 
application 

¢ The concepts provided in this tutorial can be used to develop the plan 


Risk Management Plan Outline 
Introduction Risk Monitor and Control 
Project Description Risk Register 
Risks/Issue/Opportunity Issue Management 
Descriptions Issue Contingency 
Risk Identification Risk/Issue Opportunities 


Risk Analysis Risk/Issue Training 
Risk Response Glossary 

Risk Acceptance References 

Risk Avoidance 

Risk Transfer 

Risk Escalation 


MITRE aLrotence Risk Mitigation 
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Risk Management Artifacts 


e Risk Management is supported with: 


Risk Management Policy 

Risk Management Charter 
Risk Process Description 

Risk Management Plan 

Risk Management Procedures 
Risk Management Guidelines 
Risk Management Training 


¢ This presentation will not dwell on these but content of this 
presentation can support their construction/implementation 
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Risk Identification 


¢ Risk Identification is the activity that: 


Identifies potential and current risks 


Examine elements of the program to identify associated 
potential root causes of risks 


Begin their documentation 

Sets the stage for their successful management 

Risk identification begins as early as possible in successful 
programs and continues throughout the life of the program 
Project and stakeholders from outside and inside the project 
should be involved in risk identification 
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Risk Identification 


¢ Risk can be associated with all aspects of a program; e.g. 
— Requirements 
— Threat 
— Security 
— Technology maturity 


Supplier capability 


Design 

— Schedule 

— Cost 
Performance 
— Etc. 
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Risk Description 


¢ As risks are identified it is important to correctly describe them 


¢ A well-written risk statement contains three main components: 

— Cause — The negative conditions that currently exist relative to the risk 
¢ Identification of root cause(s) of the risk 
¢ This provides justification that a risk exists 

— Probability of Occurrence — The likelihood of the occurrence of the risk 
¢ Within a future time frame 
¢ Ora future event 

— Consequence — The effect(s), negative impact(s) to the program(s) in case 

the risk occurs 


¢ The consequence should be related to at least cost, schedule, scope and 
performance 


¢* Consequence could also result in opportunities that may surface in correcting 
the problems 
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Risk Description 


e The risk is written in a chain of: Cause: IF; THEN 


Example 


An Interface Working Group has not been formed and a plan to form one 
does not exist. IF key stakeholders cannot agree on interface protocol by 


10/25/2010; THEN the schedule for development and delivery will be 
delayed causing cost overruns. 


NOTE: The cause includes assurance that the reason for the risk is valid. l.e., is 
there a compelling reasons(a root cause) to assume that stakeholders cannot 
agree on the interface protocol by 04/26/2010? Not just pie in the sky. 
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Risk Description 


¢ Proper risk descriptions helps manage the right risks 
— Risk management is time and resource consuming 
— Managing “non-risks” is not cost effective 
° Example 
A risk may be identified as a risk that component YYY will be provided 
late 
Writing this risk as: 
¢ IF component YYY is delivered late; THEN ... 
May fail to inspire interest and action 
¢ The risk is too vague, or 
¢ There is no clear reason why this is a risk 


In this case one needs to identify causal conditions that may prevent 
timely delivery of YYY. /f there are none this is not a risk! 
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Risk Description 


¢ The cause may be included in the “IF” statements for some risks 


IF scheduled delivery of component YYY continues to slip beyond 10/25/2010; 


THEN system integration will also slip causing the system to incur cost and 
schedule overruns. 


* Cause 

— Written in the IF statement 

— Schedule continues to slip 
* Occurrence 

— Schedule delivery slips beyond 04/26/2010 
* Consequence 


— Cost and schedule overruns 
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Risk Description 


¢ Avoid writing the mitigation strategy into the risk description 
— Amitigation strategy is developed after the risk has been approved 
and analyzed 
Examples 


Requirements have always been a problem in passed projects within this 


organization. IF requirements are not reviewed and verified; THEN 
requirement defects will migrate into the design. 


e Reviewed and verified are possible mitigation strategies 
¢ Write the risk in a chain of cause, occurrence, consequence 


Requirements have always been a problem in passed projects within this 
organization. IF defective requirements are not discovered and corrected by 


PDR; THEN requirements defects will migrate into the design and 


implementation causing rework, and cost and schedule impacts. 
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Risk Description 


e Risks must be written in a clear, concise and unambiguous 
fashion 


¢ Words and phrases that may have confusing and multiple 
interpretations must be avoided 
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Ambiguous Words 


¢ Avoid ambiguous words in describing risks, some examples: 


— Adequate — Limited 

— Ad hoc — Near real time 

— All — Periodic 

— Always — Portable 

— Appropriate — Rapid 

— Clearly — Several 

— Easy — Slow 

— Existing — Small 

— Fast — Sometimes 

— Flexible — State of the art 

— Future — Sufficient 

— |f required — Usable 

— Immediately — User-friendly 

— Large — Weight 

— Light — When required 
— Others? 


From IEEE standards and some preparatory requirements management plans 
MITRE Al Florence ‘!S0: http://www. ppi-int.com/newsletter/SyEN-017.php#article 


Risk Analysis 


¢ The risk is submitted to the Risk Management Board 


¢ The risk is accepted or declined by the Board 
— If declined rational is conveyed to the submitter 


e lf accepted the Risk Management Board assigns: 


— A Risk Analyst responsible for conducting risk analysis on assigned 
risks 
¢ Supported by Subject Matter Experts (SMEs) 


— A Risk Owner responsible for ensuring risks are properly managed 
throughout their life 


— Risk Analyst and Owner could be one in the same 
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Risk Analysis Components 


e Risks have the following components: 


A future root cause(s) (yet to happen) which 


¢ if eliminated or corrected, would prevent a potential consequence from 
occurring 


— Aprobability of occurrence (or likelihood) 


* assessed at the present time and updated when necessary of the future 
root cause occurring 


— The consequence (or effect/impact) of that future occurrence 


— The time horizon during which the consequences will occur if the risk is 
not mitigated 


— Risk Priorities 
¢ Mapping of probability of risk occurrence and risk consequence 
— Risk Triggers 


¢ Specific events or conditions that indicate when to develop and execute 
mitigation or contingency strategies 
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Risk Analysis 


* Qualitative Risk Analysis 


— Relative measure of risk or asset value based on ranking or separation into descriptive 
categories such as low, medium, high; not important, important, very important; or ona 
scale from 1 to 10. 

BusinessDictionary.com 

— Anexamination and prioritization of the risks based on their probability of occurring and 
the impact on the project if they do occur. Qualitative risk analysis guides the risk 
reaction process. 


pmpbank.googlepages.com/glossary 
¢ Quantitative Risk Analysis 


— Incorporates numerical estimates of frequency or probability and 
consequence. In practice, a sophisticated analysis of risk requires extensive 
data which are expensive to acquire or often unavailable. Fortunately, few 
decisions require sophisticated quantification of both frequency and 
consequences 

— Shortly spoken one might say that "quantitative risk analysis breaks down risks 
from a high medium low ranking to actual numerical values and probabilities 
of occurrence" for being able to compute the overall effects 


(comp. CROSSWIND7, p. 423) 
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Root Causes 


e A future root cause is the most basic reason for the presence of a 
risk 
¢ The cause of the risk has to be isolated and defined 
— Root causes should be initially identified when risks are identified 


— Once initial root cause are identified they may need to be analyzed 
further to determine the actual deep rooted causes of the risks 


— Root causes are documented and they support: 
¢ Establishing risk mitigation and contingency strategies 
* Improvement opportunities 
¢ Root causes can also be referred as risk drivers 


Root Cause Analysis. An analytical technique used to determine the basic 
underlying reason that causes a variance or a defect or a risk. A root cause may 


underlie more than one variance or defect or risk. ((PMBOK® Guide) -- Fourth 


Edition) Syn: root-cause analysis 
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Root Causes 


¢ Typical root causes may be associated with: 


~ Threat 

Requirements 

Technical Baseline 

Test and Evaluation 
Modeling and Simulation 
Technology 

Logistics 
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Management 

Schedules 

External Factors 

Budget 

Earned Value Management 
Production 

Industrial Capabilities 

Cost 

Others? 
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Root Causes 


Background Information 


Threat - The sensitivity of the program to uncertainty in the threat 
description, the degree to which the program would have to change 
if the threat's parameters change 


Requirements - The sensitivity of the program to uncertainty in the 
system requirements 


Technical Baseline - The approved and fixed configuration of a 
technical item at a specific time in its lifecycle that serves as a 
reference point for change control 


Test and Evaluation - The adequacy and capability of the test and 
evaluation program to assess attainment of significant performance 
specifications and determine whether the system is operationally 
effective, operationally suitable, and interoperable with the system 
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Root Causes 


Background Information 


¢ Modeling and Simulation - The adequacy and capability of M&S to 
support all life-cycle phases of a program using verified, validated, and 
accredited models and simulations 


¢ Technology - The degree to which the technology proposed for the 
program has demonstrated sufficient maturity to be realistically 
capable of meeting all of the program's objectives 


¢ Logistics - The ability of the system configuration and associated 
documentation to achieve the program's logistics objectives based on 
the system design, maintenance concept, support system design, and 
availability of support data and resources 


MITRE Al Florence Al 


Root Causes 


Background Information 


Management - The degree to which program plans and strategies exist 
and are realistic and consistent. The program support team should be 
qualified and sufficiently staffed to manage the program 

Schedule - The sufficiency of the time allocated for performing the 
defined tasks 

External Factors - The availability of resources external to the program 
that are required to support the program such as facilities, resources, 
personnel, government furnished equipment, etc. 

Budget - The sensitivity of the program to budget variations and 
reductions and the resultant program turbulence 


Earned Value Management (EVM) - The adequacy of the EVM process 


and the realism of the integrated baseline for managing the program 


MITRE Al Florence 


42 


Root Causes 


Background Information 


¢ Production - The ability of the system configuration to achieve the 
program's production objectives based on the system design, 
manufacturing processes chosen, and availability of manufacturing 
resources 


¢ Industrial Capabilities - The abilities, experience, resources, and 
knowledge of the contractors to design, develop, manufacture, and 
support the system 

¢ Cost - The ability of the system to achieve the program's life-cycle cost 
objectives. This includes the effects of budget and affordability 
decisions and the effects of inherent errors in the cost 
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Probability of Occurrence 


¢ Probability of occurrence assessed, at the present time, is the 
probability of a future root cause occurring 


¢ The chance of a risk occurring is rated on a scale between >0 
and 1 
¢ When the probability of occurrence = 1; (100%) 


— The risk has occurred; it then becomes an issue and is managed as an 
issue 
¢ For most risks, estimating the precise probability of 
occurrence may be difficult 


— Analysis by SMEs may be necessary, and often using Best Engineering 
Judgment 
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Probability Scores 


Probability of occurrence may begin with a qualitative 


description of probability, which will tie to a numeric range of 
probability. 


Sample Risk Probability Scores 


Probability Description Probability % of 
Occurrence 
Very High (Extremely likely) 281% and =100% 


High (Probable) 61% — 80% 


Medium (Possible) 41% — 60% 


Low (Unlikely) 21% — 40% 
Very Low (Highly improbable) >I% — $20% 


MITRE Al Florence 


45 


Consequence of Risk Occurrence 
(Impact) 


e Risks are reviewed for the effect that they would have on the 
project’s objectives and other elements of the program 

¢ The level of impact, may be rated from very low (1) to very 
high (5), and is assessed against at least four categories: 
— Cost 
— Schedule 
— Scope 
— Performance 
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Consequence of Risk Occurrence 


Program/Project 


Objective 


Schedule 


Very Low Low Medium High Very High 
Minor Moderate Serious Critical Catastrophic 


Insignificant 
increase 


Insignificant 
slippage 


Scope decrease 
barely noticeable 


Increase 

< 2% of 

budget baseline 
Slippage < 2% of 
project baseline 
schedule 


Minor areas of 
scope affected 


Performance 
degradation 
noticeable, but 
does not fail 
acceptance 


Increase 
2-5% of 
budget baseline 


Slippage 2—5% of 


project baseline 
schedule 


Major areas of 
scope affected 


Performance 
reduction 
requires sponsor 
approval 


Increase 

6-10% of 
budget baseline 
Slippage 6-10% 
of project 
baseline 
schedule 


Scope reduction 
unacceptable to 
sponsor 
Performance 
reduction 
unacceptable to 
sponsor 


Increase 

> 10% of 

budget baseline 
Slippage > 10% 
of project 
baseline 
schedule 
—OR~— 
Slippage past a 
milestone 
mandated by 
Congress 
Project outcome 
is effectively 
useless 

Project outcome 
is effectively 
useless 


Performance Performance 
degradation 
barely noticeable 
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criteria 


Time Horizon 


e¢ There are at least three dates that may be specified for each 
risk: 
— Near risks are those in which the earliest date of the risk impact is 
within xx days of the present date 
— Mid risks are those in which the earliest date of risk impact is between 
xx and zz days from the present date 
— Far risks are those in which the earliest dates of the risk impact are 
greater than zz days from the present date 
(xx<zz) 
¢ These dates are used as triggers to track when the risk will 
begin to impact the program and/or when the risk has been 
overcome by events 


Near Risks Mid Risks Far Risks 
X 7Z Time 
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Risk Exposure 


¢ Risk exposure. (ISO/IEC 16085:2006 Systems and software 
engineering--Life cycle processes--Risk management 
(1) the potential loss presented to an individual, project, or 
organization by a risk 
(2) a function of the likelihood that the risk will occur and the 
magnitude of the consequences of its occurrence 


e Risk exposure can also be called Risk Priority 


— The priority of a risk helps to determine the amount of resources and time 
that should be dedicated to managing and monitoring the risk 

— Very Low, Low, Medium, High, and Very High priority is assessed by using 
probability and impact scores 

— The potential timing of a risk event may also be considered when 
determining risk management actions 
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Risk Priorities 


Impact 
Very High 
High 
Medium 


Low 


Very Low 


Very Low Low Medium High Very High 
Probability of Occurrence 


| | [| Li yy 


Very Low Low Medium High Very High 
Priority Priority Priority Priority Priority 
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Risk Priority vs. Mitigation/Contingency 


Very Low Medium High Very High 
Priority ely Priority Priority Priority 
Risk Monitor Monitor Monitor Monitor 
li Develop Develop 
Mitigation Contingency 
Strategy Strategy 


Very Low Priority Risks are placed in a Risk Watch List which are 


periodically monitored. 
Other Risks are monitored more aggressively. 
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Risk Priorities & Time Horizon 


The potential timing of a risk event may also be considered 


when determining risk management actions 


Medium 


ae 
Time Far Near 
Horizons Impact Impact 
New 
Priorities | WVeryLow Medium 


Priority Priority 


Far 
Impact 


Low 
Priority 


Near 
Impact 


High 
Priority 


High 


Far Near 
Impact Impact 


Medium Very High 
Priority Priority 


Time Horizons may influence the Risk Priority 
(Mid Time Horizon should not influence risk priority change) 


Priorities may change over time 
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Identifying Triggers 


¢ Triggers are specific events or conditions that indicate when 
to execute mitigation or contingency strategies 
e Unless a condition is immediate, a trigger should be defined 
e Examples of triggers may include: 
— Cost performance 
— Schedule performance 
— Results of management reviews 


— Occurrence of the risk 


° asa trigger for execution of contingency strategies 
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Risk Response 


e Risk response is the process of developing options and 
determining actions to enhance opportunities and reduce 
threats to the project’s objectives 

e Risk response must be 

— Appropriate to the significance of the risk 
— Cost effective in meeting the challenge 
— Timely and realistic within the project contend 
— Agreed to by all parties involved 
PMPOK 
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Risk Response 


e Risk Responses has at least five components 


Acceptance 

Avoidance 

Transfer 

Escalate 

Mitigate (contingencies — for issues) 


e Acceptance — Accept the consequences of the risk occurring 


Other responses may not be possible 

Cost to respond may be greater than the benefit 

May not be possible to prevent the impact if the risk occurs 
Impact may be negligible 


Risk may be imminent and should be handled as an issue 
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Risk Avoidance/Transfer 


— Avoidance (covered later in presentation) 
¢ Eliminate the sources of high risk and replace them with a lower- 
risk alternative 
¢ Risk avoidance with good management and engineering practices 
— Transfer - Shift the responsibility of managing and resolving the 
risk to another party 
¢ May be better able to manage the risk 
¢ May be the proper owner of the risk 
¢ Transfer could be from one party to another within the same 
organization 
¢ Transfer could be to a completely different organization 
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Risk Escalation 


¢ Escalation - Risks should be managed at the lowest practical 


level 


— But conditions may arise where a risk should be escalated to higher 
levels of management or beyond the program/project 


— The next higher organizational (Governance) entity may be able to 
better to handle the risk/issue 


— Thresholds may exist that determine escalation 


Cost of impact 

Schedule effect of Impact 
Scope of impact 
Performance effect of impact 
Time critical 

Cost critical 
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Risk Mitigation 


¢ Taking early action to reduce the probability and/or impact of 
a risk occurring is often more effective that trying to repair 
the damage after the risk has occurred 


e Adapting less complex processes, conducting more tests, or 
choosing a more stable supplier are examples of mitigation 
actions 


PMBOK 
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Risk Mitigation 


¢ The following are important guidelines for effective risk 
mitigation: 
— Prepare detailed mitigation strategies for all medium, high 
and very high risks 


¢ With sufficient detail about what is to be done, when, where, 
and by whom 


— Develop mitigation strategies as early as possible, allowing 
time to address risks needing special attention or action 


¢ Helps reduce the chance of having high-priority risks appear 
at the last moment on the critical path 


— Prepare contingency strategies for all high and very high 
priority risks and risks imminent to occur 


MITRE Al Florence 


59 


Risk Mitigation 


Background Information 


¢ Adaptations of the following strategies can be applied toa 


range of risks. This list is intended merely as a starting point 


for thinking about risk mitigation 


Multiple Development Efforts - Create competing systems in parallel 
that meet the same scope and performance requirements 


Alternative Design - Create a backup design option that uses a less 
risky approach 


Trade Studies — Conduct studies to arrive at the least risky solution 


Early Prototyping - Build and test prototypes early in the system 
development 


Incremental Development - Design with the intent of upgrading 
system parts in the future 
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Risk Mitigation 
Background Information 
— Technology Maturation Efforts - Normally, technology maturation is used 


when the desired technology will replace an existing technology that is 
available for use in the system 


— Robust Design - This approach, while it could be more costly, uses 
advanced design and manufacturing techniques that promote quality 
through design 


— Reviews, Walk-Throughs, and Inspections - These three actions can be used 
to reduce the probability/likelihood and potential consequences/impacts 
of risks through timely assessment of actual or planned events 


— Design of Experiments - This engineering tool identifies critical design 
factors that are sensitive, and therefore potentially high-risk, to achieve a 
particular user requirement 
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Risk Mitigation 


Background Information 


¢ Open Systems - Carefully selected commercial specifications and 
standards, which can result in lower risks 


e Use of Standard Items/Software Reuse - Use of existing and proven 
hardware and software, where applicable, can substantially reduce risks 


¢ Use of Mock-Ups - The use of mock-ups, especially man-machine interface 
mock-ups, can be used to conduct early exploration of design options 


¢ Modeling/Simulation - Modeling and simulation can be used to investigate 
various design options and system requirement levels 


¢ Key Parameter Control Boards - The practice of establishing a control 
board for a parameter may be appropriate when a particular feature (such 
as system weight) is crucial to achieving the overall program requirements 
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Issue Contingency 


e Issue contingencies are developed for high and very high priority 
risks 


¢ Covered further under issues 
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Probability of occurrence 40% — Low 
Consequence of occurrence — Very High 
Risk Priority - Medium 

Mitigation — Hit breaks 
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Train approaching 2 mile away going 60 mph 
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Risk Monitoring and Control 


¢ In order to effectively monitor and control risks a Risk 
Repository needs to be established 
— Also called a Risk Register 


¢ There are many risk tools that provide repository capabilities: 
— Home developed tools 
— Commercial tools 
— Corporate/agency tools 


Note: Risk register implementation may depend on project size. A 
month long project might just need a spread sheet table whereas a 


multi-year, geographically dispersed project may require an internet and 
SQL-based database tool. 
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Risk Control 


e Risk control involves: 
— Plan and execute actions that reduce the probability/impact of a risk 
on the project’s objectives (i.e., mitigation); and/or 
— Establish a feasible impact control plan for the realization of the risk 
(i.e., contingency) 
— Control includes the decision to: 
¢ Close risks 
¢ Mark risks as occurred 


¢ Update probability and impacts and other details (conduct additional 
analysis) 


MITRE Al Florence 


66 


Risk Records 


¢ Risk and Issue records in a risk/issue repository serve 
several purposes: 


— Reporting and communicating information to others who might 
be impacted or who might be able to help manage an item 


— Providing risk lists and status for reviews with stakeholders 


— Assisting the risk originator and owner the collection of 
information about an item 

— Helping risk owners and others to easily access risk and issue 
information, and manage that information to the benefit of the 
organization 
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Risk/Issue Repository 


e Suggested contents of repository 


Category of risk (schedule, cost, technical, management, etc.) 
Risk Identifier 
¢ Unique alpha numeric identifier of each risk/issue 


Risk Name 


¢ Descriptive name of risk or issue 


Risk Description 
°* Cause 
¢ Probability of Occurrence - IF 
* Consequence - THEN 
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Risk/Issue Repository 


e Suggested contents of repository 
— Stage in which the risk exists at time 
¢ Analysis, Mitigation, Contingency, Issue, Closed 
— Priority 
¢ Very Low, Low, Medium, High, Very High 
— Impact 
¢ Very Low, Low, Medium, High, Very High 
— Probability of Occurrence 
e Larger then zero equal to 1 for risks 
¢ If 1 it becomes an issue 
— Risk Triggers 
— Mitigation Strategies 
— Contingency Strategies 
— Notes 
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Risk Monitoring 


¢ Risk monitoring involves 


— Tracking individual risks, primarily by reviewing the status of their 
mitigation strategies, probability, consequence, and other information 
— Risk Monitoring includes: 
¢ Continuous reassessment of risks 
¢ Reporting on risks 
— Continuously analysis and status updates in the Risk/Issue Repository 


— Providing evidence to outside governance bodies that the program and 
its projects have identified sources of uncertainty and possible failure 


Risk Monitoring provides data and status for Risk Control activities 
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Risk Monitoring 


¢ Critical review makes certain that the solution is fixing the 
root cause wherever possible and prepares the risk owner 
and project to answer the following questions: 


— What is the expected reduction of probability and impact? Is it 
documented? Is it a sufficient reduction? 


— Can the option be feasibly implemented and still meet the user’s 
needs? 


— ls time available to develop and implement the option? 


— ls the mitigation strategy affordable in terms of cost and other 
resources (e.g., use of critical materials, test facilities, etc.)? Does the 
benefit outweigh the cost? 


— What effect does the option have on the overall program schedule? 


— What effect does the option have on the system’s technical scope and 


performance? 
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Risk Monitoring 


e Risk reports can be in the form of text reports and/or graphs 


¢ The following are examples of reports and metrics that can be 
reported: 


Open Risk/Issues by Priority by Month 
Closed Risks/Issues Current Month 
Risk/Issue Plans 

¢ Current and next month 
Risk/Issue Transfer Current Month 
Risk/Issue Escalation Current Month 
Risk/Issue Activity History 
Risk/Issue for Management Attention 
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Risk Status 


¢ Risk monitoring includes constant monitoring and providing 
Status of the risks including 

— Analysis the current status of the risks 

— Updates the 
¢ Probability of occurrence 
¢ Impact of occurrence 
¢ Other risk parameters 
¢ Mitigation strategies 
* Contingency strategies 
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Risk Closure 


e Risks are closed when: 
— They are no longer a threat (the risk lessened or vanished) 
— They have been mitigated 
— They have been transferred or escalated 
¢ The new owners now manage and monitor the risk 


¢ When risks occur they now become Issues and may be closed 
as risks or left open in the repository as Issues 
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Risk 


Probability of occurrence 75% — High 
Consequence of occurrence — Very High 
Risk Priority — High 

Mitigation — Jump out of car 


Signal Broken 
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Brakes did not work Train approaching 1/2 mile away going 40 mph 
Car stalled on tracks 


Battery dead 
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Tutorial Objectives 
Introduction 

Reasons for Risk/Issue Management 
Opportunities 

Risk Management 

Issue Management 
Risk/Issue Avoidance 
Risk/Issue Opportunities 
Questions/ Discussion 
References 
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Issue Management 


An issue is an event that has occurred or will occur 


with certainty and adversely affects the ability of the 
project or program to meet its objectives 
a) A formally identified adverse condition related to a 
program 
Used in 


a1) Had not been identified as a risk prior to its occurrence 
Next slide 


a2) Had been identified as a risk prior to its occurrence but had 
not been managed as a risk 


b) A program risk that has occurred or is imminent to occur 


¢ Reached its probability of occurrence of 1 (one) or 100% 


¢ Not yet occurred but the probability of occurrence is 
approaching 100% 


— At this time should be managed as an issue 


Some concepts from: PM@UTS Learning Program Step by step guide to 
project management 
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Issue Management 
POW! POW! 


ISSUE ISSUE 


SUPPRISE I TOLD YOU SO! 


TIME Risk 
occurred 


Risk mitigation Strategies 
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Issue Management 


¢ If program/project issues are not addressed they may: 
— Affect program/project schedule 
— Increase program/project cost 
= Change program/project scope 
— Diminish program/project performance 
e Issues can be associated with all aspects of a program (e.g., 
threat, technology maturity, supplier capability, design, 
performance against plans) as these aspects relate across the 
Work Breakdown Structure and Integrated Master Schedule 
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Issue Management Flow 


Issue Has 
Occurred 


Analyze Issue 
and 
Develop 
Contingency 
Strategies 


Contingency 
Strategies Been 
Developed 


Execute 
Contingency 


Strategies Continue 


Issue 
Managment 


Should 
Issue be 
Transferred or 
Escalated 


Should 
Issue be 
Closed 


Yes 
Close Issue 


Continuously Monitor and Control Issue 


Transfer or 
Escalate Issue 
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Issue Management 


¢ Issue Management quickly identifies and effectively resolves 
problems as they occur and involves: 
— Issue Identification 
— Issue Analysis 
— Issue Response 
— Issue Monitoring and Control 
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Issue Identification 


e Issue identification activities are similar to those for risk 
identification 

e |f the issue is one that occurred, without being associated 
with a risk, then it needs to be identification 

e Issue identification would have been done if the issue 
resulted from a risk occurring 


— Regardless issues may need additional identification 
¢ Especially in identifying root causes 
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Issue Description 


e lf the issue was a risk that occurred it should have been 
described with the risk description 


e lf the issue was not related to a risk the issue needs to be 
described 
— The conditions that caused an issue to occur along with root cause(s) 
need to be identified and described 
¢ This includes the consequences of the issue occurrence 
— The risk writing guidelines presented earlier can be used as 
appropriate to issues 
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Issue Analysis 


e Issue analysis activities are similar to those for risk analysis 
— If an issue is a risk that has occurred, some, if not all, risk analysis may 
be sufficient for the issue 
¢ The issue may need additional analysis due to its impact on 
program/project activities and products 
— lf the issue is one that occurred without it being associated with a risk 
then issue analysis needs to be conducted 
¢ The root cause needs to be identified 


¢ Impact level, rated from very low (1) to very high (5), is assessed in at 
least four categories: 


— Cost 

— Schedule 

— Scope 

— Performance 
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Issue Response 


e Issue response could include 
— Acceptance 
¢ Accept the consequence of the issue 
¢ Same reasons as acceptance of risks 
— Transfer 


e Ifthe occurred risk had not been transferred the issue responsibility may 
now be shifted to another party who is better equipped to deal with the 
issue 


— Escalate 


e If the occurred risk had not been escalated the issue responsibility may 
now be escalated to higher authority based on threshold described earlier 


— Contingencies 
¢ Can be developed using the similar methods described for risk mitigations 
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Issue Response 


e Issue contingencies are strategies to eliminate or reduce the 
negative effect of the issue 
e Issue contingencies should have been developed for issues 
that were the result of a risk occurring 
— If not they need to be developed 
— They may need to be enhanced 
¢ If they were associated with risks earlier 
¢ For issues that were not the result of a risk occurring 
contingencies need to be developed 
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Issue Monitoring and Control 


e Issues are monitored and controlled until they are closed 


e Issues are monitored and controlled using similar methods 
described for risk monitoring and control 
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Risk/Issue 


Probability of occurrence 97% — Very High 
Consequence of occurrence — Very High 
Risk Priority — Very High 

Contingency — Pray 
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for real! 
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Black Swan Events 


The Black Swan: The Impact of the Highly Improbable; 
Nassim Nicholas Taleb 


WIKIPEDIA 
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Black Swan Events 


¢ Black Swan Events were described by Nassim Nicholas Taleb 
in his 2007 book, The Black Swan 

¢ Taleb regards almost all major scientific discoveries, 
historical events, and artistic accomplishments as "black 
swans —undirected and unpredicted 


¢ He gives the rise of the Internet, the personal computer, 
World War I, and the September 11, 2001 attacks as 
examples of Black Swan Events 
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Black Swan Theory 


¢ The Black Swan Theory is used by Nassim Nicholas Taleb to 
explain the existence and occurrence of high-impact, hard- 
to-predict, and rare events that are beyond the realm of 
normal expectations 


¢ Such events are considered extreme outliers 
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Black Swan Events 


¢ The main idea in Taleb's book is not to attempt to predict Black Swan 
Events 


— but to build robustness into negative ones that occur and being able to 
exploit positive ones 


¢ Taleb contends that banks and trading firms are very vulnerable to 
hazardous Black Swan Events and are exposed to losses beyond that 
predicted by their defective models 


— Sounds familiar? Al Florence 
¢ Taleb states that a Black Swan Event depends on the observer 


— using a simple example, what may be a Black Swan surprise for a turkey is 
not a Black Swan surprise for its butcher 


— hence the objective should be to "avoid being the turkey" by identifying 
areas of vulnerability in order to "turn the Black Swans white" 
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Black Swan Bottom Line 


e Black Swan Events are events that have an extremely low 
probability of occurrence 
— cannot be predicted 

e But have a very high consequence if occur 
— positive or negative 

¢ Mitigation is near impossible for negative ones since it is not 
known when, where and how or if they will occur 


Al Florence 


How about an All Black Penguin? 
Discovered March 11, 2010 near Antarctica 


One in a zillion occurrence 
So, what would a All Black Penguin event be? 
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Risk/Issue Avoidance 


¢ Risk/Issue Avoidance has at least two components: 
— Eliminate the sources of high risks and issues and replace them 
with a lower-risk alternatives 
— The establishment of sound technical, programmatic and 
management processes, and activities early and their continued 
execution throughout the entire lifecycle 
¢ This helps remove common risks/issues root causes 
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Low-Risk Alternatives 


e Eliminate the sources of high risk and replace them with a 
lower-risk alternatives 
— The selection and implementation of alternative activities or products 
without, or with lower, risk to replace the riskier activities or products 


— These alternatives may eliminate or reduce the impact if the risk 
occurs 
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Alternative Approaches 


¢ Risk analysis and mitigation involves the investigation and 
implementation of alternative approaches which may include: 
— Technical 
¢ Example: substitute COTS products, relax requirements 
— Management 
¢ Example: reassign tasks, augment teams 
— Programmatic 


¢ Example: manipulate schedules, reduce documentation, 
increase budgets 


MITRE Al Florence 98 


Industry Best Practices 


¢ Implementing industry best practices within organizations and 
executing them on projects can drastically reduce risks and 
issues 


¢ Best practices include technical and programmatic processes 
and procedures 
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SEI CMMI 


¢ Software Engineering Institute (SEI) Capability Maturity 
Model Integration (CMMI) 


— CMMI for Development v1.2— For suppliers developing/supplying 
¢ Software 
¢ Hardware 
¢ Systems 
¢ Commercial of the Shelf (COTS) 
— CMMI for Acquisition v1.2 
¢ For customers acquiring systems, products and services 
— CMMI for Service v1.2 


¢ For organizations providing services 


All these CMMs have process areas for most activities associated with 


program/project development and acquisition 
Their proper implementation would result in best practices 
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SEI CMMI 


CMMI Process Areas for CMMI for Development v1.2 


5 - Optimizing Organizational Innovation and Deployment 
Causal Analysis and Resolution 

4- Quantitative Managed Organizational Process Performance 
Quantitative Project Management 


3 - Defined Requirements Development 
Technical Solution 

Product Integration 
Verification 

Validation 

Organizational Process Focus 
Organizational Process Definition 
Organizational Training 
Integrated Project Management 
Risk Management 

Decision Analysis and Resolution 


Risk 
Reduction 


2 - Managed Requirements Management 

Project Planning 

Project Monitoring and Control 
Supplier Agreement Management 
Measurement and Analysis 

Process and Product Quality Assurance 


Confi ement 


1 - Initial Competent people and heroics, sometimes ad hoc (Subject to high incidence of RISKS) ,},, 
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SEI CMMI 


The CMMI is itself a Risk Management Plan 


Managing Risks, Methods for Software Systems Development; Dr. Elaine M. Hall, 
SEI Series in Software Engineering 
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Other Frameworks 


¢ Other Methodologies/Frameworks 
— 6Sigma 
¢ Process Improvement 
¢ Reduce variation 
¢ Statistical/quantitative 
— Lean 6 Sigma 
¢ Process Improvement 
¢ Reduce Waste 
¢ Less statistically rigorous then 6 sigma 
— |TIL—Information Technology Infrastructure Library 
¢ For Information Technology 
¢ Services Focused 
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Other Frameworks 
— ISO 9000 standards 


¢ ISO 9001 - applies to companies required to design, develop, 
produce, install, service and supply a product or service 


¢ ISO 9002 - applies to companies required to produce, install, 
service and supply a product or service according to an 
existing design 


¢ ISO 9003 - addresses only the requirements for detection and 
control of problems during final inspection and testing 


— Others 
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Reducing Risks with the Proper 
Specification of Requirements 


The next presentation was published as a paper in Crosstalk, The Journal of 
Defense Software Engineering, April 2002 by Al Florence 
Title of the publication: 


RISKY Requirements 


It also received an award in the best paper competition at MITRE 


December 17, 2008 — Computerworld — 
Melinda-Carol Ballou, an analyst with IDC in Framingham, Mass., said 


that 70% to 80% of IT project failures relate directly to poor requirements 
gathering, management and analysis. 


And specification — Al Florence 
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Proper Specification of Requirements 


¢ Agovernment agency, while modernizing their information systems, 
reverse-engineered requirements 


¢ With domain knowledge of the application, several teams were 
involved 


— They represented 
¢ Users 
* Contractors 
* Acquisition organization 
¢ This author was assigned as a consultant to guide the teams in the 
proper specification of requirements 
¢ The examples presented show some of the requirements: 
— As initially specified by the teams 
— Next a critique of the requirements by this author 
— Finally the re-specified requirements based on the critique 
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Criteria for Specifying a Good 
Requirement 


The following are some critical attributes that requirements must 
adhere to: (Used to critique requirements) 


¢ Completeness: Requirements should be complete 


They should reflect system objectives and specify the relationship 
between the software and the rest of the subsystems 
¢ Consistency: Requirements must be consistent with each 
other; no requirement should conflict with any other 
requirement 


Requirements should be checked by examining all requirements in 
relation to each other for consistency and compatibility 
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lag 


£ Criteria for Specifying a Good 
Requirement 


¢ Traceability: Each requirement must be traceable to some 
higher-level source, such as a system level requirement 
Each requirement should also be traced to lower level design and test 
abstractions such as high-level and detailed-level design and test cases 
¢ Testability: All requirements must be testable in order to 
demonstrate that the software end product satisfies its 
requirements 
In order for requirements to be testable they must be specific, 


unambiguous, and quantitative whenever possible. Avoid negative, 
vague and general statements 
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Criteria for Specifying a Good 
Requirement 


¢ Feasibility: Each requirement must be feasible to implement 


Requirements that have questionable feasibility should be analyzed 
during requirements analysis to prove their feasibility 
¢ Unique identification: Uniquely identifying each requiremen 
is essential if requirements are to be traceable and testable 


t 


Uniqueness also helps in stating requirements in a clear and consistent 


fashion 
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Criteria for Specifying a Good 
Requirement 


¢ Design Free: Software requirements should be specified at a 
requirements level not at a design level 
The approach should be to describe the software requirement functionally from a 
system (external) point of view, not from a software design point-of-view, i.e. 
describe the system functions that the software must satisfy. Some requirements 
may have design embedded due to constraints placed on them by the system, 
interfaces or legacy 


¢ Use of “shall” and related words: In specifications, the use of the word 
"shall" indicates a binding provision 

Binding provisions must be implemented by users of specifications. To state non- 

binding provisions, use "should" or "may". Use "will" to express a declaration of 


purpose (e.g., "The Government will furnish..."), or to express future tense. MIL- 
STDs 


Note: Methods other that the use of “shall” can be used to specify requirements such as 


using a matrix with a column for requirements and another column for comments or italics 
or underlines for comments. 
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Example 1 


¢ Initial specification 
The Financial Agent sends to the government by 6:00 PM ET on the 
same day after receipt of the file CRDF that includes only critical data 
collected from the enrolled individual. 
° Critique 
— No unique identifier provided 
— The word “shall” is missing 
— How is the file sent? 
— Has design implications: “CRDF” 


¢ Should define data, not name of data file - this should be done in 
the design 


— The critical data has to be identified 
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Example 1 


¢ Re-specification 

3.3.1.3 The Financial Agent shall send the government, via 
electronic transmission, the following critical data collected 
from each enrolled individuals by 6:00 PM ET on the day of 
receipt: 

a. Name 

b. Address 

c. Zip Code 

d. Social Security Number 
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Example 2 


¢ Initial specification: 
3.2.5.7 The system shall process two new fields (provides 
production count balancing info to states) at the end-of-state 
record 
° Critique: 
— This requirement cannot be implemented or tested. 
— Itis incomplete. What are the two new fields? 
— “Info” should be spelled out 
¢ Re-specification: 
3.2.5.7 The system shall provide the following data items 
(provides production count balancing information to states) at 
the end-of-state record: 
a. SDATE, and 
b. YR-TO-DATE-COUNT 
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Example 2 


° Re-Critique: 
— This rewrite has design implications SDATE record and YR-TO-DATE- 
COUNT 


¢ From a requirements viewpoint it should specify what the data in 
the records are, not the name of the record as it exists in the 
design and implementation 


e Re-Re-Specification: 


3.2.5.7 The system shall provide the following data items (provides 
production count balancing information to states) at the end-of-state 
record: 


a. Submission date and time 
b. Year-to-date totals 
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Example 3 


¢ Initial specification: 


3.2.5.9 All computer-resident information that is sensitive shall have 


system access controls. Access controls shall be consistent with the 
information being protected and the computer system hosting the data. 
° Critique: 
— Two “shalls” under one identifier 
— The requirement is vague and incomplete. Need to identify the sensitive 
information. 
— What does “consistent” mean? 
— As specified it cannot be implemented or tested 


¢ Re-specification: 
3.2.5.9 All sensitive computer-resident information shall have system 
access controls, consistent with the level of protection. (Reference 
Sensitive Information, Table 5.4.1 and Level of Protection for Sensitive 
Information, Table 5.4.2) 
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Example 4 


¢ Initial specification: 
Software will not be loaded from unknown sources onto the system 
without first having the software tested and approved 
© Critique: 
— If itis tested and approved, can it be loaded from unknown sources? 
— If the source is known, can it be loaded without being tested and 
approved? 


— Requirement is ambiguous and stated as a negative requirement, 
which makes it difficult to implement and test 


— Aunique identifier is not provided, which makes it difficult to trace 
— The word “shall” is missing 


MITRE Al Florence ae 


Example 4 


¢ Re-specification: 


3.2.5.2 Software shall be loaded onto the operational system only 
after it has been tested and approved 
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Example 5 


¢ Initial specification: 
3.2.7.1 The system shall purge state control records and files that are older 
than the operator or technical user-specified retention period 
° Critique: 
— Requirement is incomplete and vague without specifying the 
retention period or providing a reference as to where the information 
can be obtained 
— Requirement cannot be implemented or tested as stated 
e Re-specification: 
3.2.7.1 The system shall purge state control records and files that are older 
than the retention period input into the system by either the 
a. operator, or 
b. technical user 
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Example 6 


Initial specification: 
3.3.2.1 The system shall have no single point failures 


Critique: 
— This is an ambiguous requirement. Needs identification of what 
components and/or functions the “no single point failures” applies to 
— As specified it cannot be implemented or tested 
Re-specification: 
3.3.2.1 The following system components shall have no single point 
failures: 


a. Host servers e. Hubs 

b. Networks f. Switches 

c. Network routers g. Firewalls 

d. Access servers h. Storage devices 
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Example 7 


¢ Initial specification: 


3.2.6.3 The system shall receive and process state return data from the 
State Processing Subsystem. The system shall provide maintenance of the 
state data files and generate various reports. 
° Critique: 
— Two “shalls” under one requirement number and multiple 
requirements in the specification 


— The word “process” in the first shall is vague; need to define the 
processing required 


— The second “shall” does not provide for valid requirements, they 
cannot be implemented or tested as stated 
¢ Needs identification of type/amount of maintenance required 
e “various reports” is ambiguous 
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Example 7 


¢ Re-specification: 
3.2.6.3 The system shall receive: 
a. production data that contains data from multiple states, and 
b. state total amount for one or more states, 
extracted by the Returns Processing Subsystem. 
3.2.6.4 The system shall parse multi-state data to respective state files 


3.2.6.5 The system shall display a summary screen reporting the results 
of processing for each state containing: 


a. state totals, 
b. state generic totals, and 
c. state unformatted totals. 
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Example 8 


¢ Initial specification: 


3.2.9.1 When doing calculations the software shall produce correct 
results. 
° Critique: 
— Really? This is not a requirement. 
— This type of non-requirements should not be specified! 


— \|t should be deleted. 
¢ Re-specification: 


Requirement deleted. 
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Risk/Issue Opportunity 


¢ An Opportunity is a potential event which, if taken advantage 
of, will positively affects the ability of the project or program to 
meet its objectives 
— Opportunities to improve project performance may surface while 
applying mitigation or contingency strategies 
— The mitigation or contingency strategies could be used as best 


practices on the project or other projects to keep the risk from 
recurring 
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Risk / Opportunity 


e An opportunity may be the potential of improving the value of 
project results; the project itself is the paramount opportunity 

¢ Arisk is the potential of not achieving the project strategic 
opportunity 

¢ Taking risks can lead to opportunities but risk taking can itself 


be quite risky unless the risk is well thought out and well 
managed 
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Capturing Lesson Learned in Support of 
Opportunities 


Contingency Strategy Reduced Impact 


ISSUE 
TIME 


Oe  ) 


RISK > 
Risk Mitigation Contingency Strategy 
Reduced Impact 


Mitigation Strategy Mitigated Risk 


ISSUE 


Stored in lessons learned database which can be documented as a best practice 


opportunity to be reused on this or other projects to keep the risk or issue from recurring 
(Hopefully Identified and corrected Root Cause) ( Also Called Process Improvement) 
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Real Project Example 


¢ Opportunity 
— Galileo Space Probe to Jupiter to investigate the Jovian atmosphere and 
gather scientific information 
° A Risk 
— Voyager Space Craft on flyby of Jupiter discovered high radiation, which 
destroys electrical components, and high incidences of cosmic ray events, 
which flips volatile computer bits 
— IF the Galileo Probe is not designed to protected against this phenomena 
prior to launch 
— THEN the microprocessor may fail before the mission is accomplished 
resulting in less science collected or complete mission failure 
¢ A mitigation strategy was developed and deployed 
— Redesign the configuration of the probe to protect volatile bits and 
electronic components 
¢ Issue 
— Did not materialize 
* Opportunities 
— Galileo Probe was successful and accomplished its full mission 
— Lessons learned were used on other space missions 
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Real Project Example 


° Mitigation 
— Initial design had one microprocessor to command and control the 
instruments, collect scientific data and telemeter to orbiter 
— Eliminate 2 experiments and install 2"? microprocessor 
¢ Both redundantly collecting same data and sending to orbiter 
¢ Place processors in the center of probe 


— Provide for redundant triple collection and triple voting on both 
processors on critical parameters such as timing 


— Hopefully when one processor destroyed the other may continue to 
operate 


This mitigation (redesign) extended the life of science gathering until probe implosion 
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Issue/Opportunity 


Probability of occurrence 100%; risk occurred 


Now this is a real issue! 
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Too late for 


. ; Harvest lessons learned for Improvement 
Contingencies 


Opportunities 
(Fix signal and install closing gates on both sides of 
tracks, examine breaks and doors on cars) 


The good news is that no one was hurt, 


obviously this is a toy train and toy cars 
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Stove-piped 
Sys S, 


Vision Net-Enabled |) 2%, 
Industry working together with our customers to Future Ey rE, 
provide a network centric environment where all 
classes of information systems interoperate by 
integrating existing and emerging open 
standards into a common evolving global 
framework that employs a common set of 
principles and processes. 


Today: 
Stovepiped Mission 
Systems, Our mission is to facilitate the global realization 
Point-to-Point of Network Centric Operations. We seek to 
Networks enable interoperability across the spectrum of 


joint, interagency, intergovernmental, and 
multinational industrial and commercial 
operations. NCOIC is global, with membership 
open to those who wish to apply the vast 
potential of network centric technology to the 
operational challenges faced by our nations and 
their citizens. 
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NCOIC exists to facilitate the global realization of Network Centric 
Operations/Net Enabled Capability. We seek to enable interoperability across 
joint, interagency, intergovernmental, and multinational industrial and commercial 


operations. 
¢ Global Organization 


¢ Voice of industry 
¢ Cadre of technical experts 


¢ Dedicated to interoperability 


¢ Advisory Council of senior advisors who help prioritize 
our work in a non-competitive environment 


In the photo: BrigGen Dieter Dammjacob (DEU AF)-J3 NATO Supreme Headquarters, Allied Powers Europe; Lt.Col. Danut Tiganus-ClIS 
Directorate, EU Military Staff; Dr. Tom Buckman-NC3A Chief Architect; Gen Harald Kujat,-German AF (Ret.) former Chief of Staff of German 
Armed Forces & head of NATO Military Committee, Marcel Staicu-European Defense Agency NEC Project Officer . 


NCOIC Members 


= 80+ Member Organizations 1 
including leading IT and Aerospace & = aa 
Defense companies, government 4 FS 
organizations, non-governmental 

organizations and academic 
institutions 

= Members from 18 Countries 

= Advisors from 26 key stakeholders 
from Australia, EDA, France, 
Germany, Italy, NATO, The 
Netherlands, Sweden, UK and US 


Technical Council 


Working Group collaboration 


Terry Morgan honors outgoing Advisory Council Chair, Keith Hall 
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= NCOIC facilitates interoperability by collaboration 
= Member organizations & Advisory Council 
= Our member’s customers 
= Agencies of global governments 
= Other NCO stakeholders 


= Collaboration occurs through 
= Invited Review of developing documents & architectures 
= Joint demonstrations and white papers 
= Joint and hosted forums, symposia and workshops 

Joint technical development with stakeholders 

LOI, LOA, MOU, CRADA and other agreements 


Photo and screen captures from member lab 
interoperability demonstration, Rome, May 2010 


NCOIC provides guidance for network centric standards and their patterns of use. 
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bets all 

¢ “The Australian Department of Defence is a keen supporter of NCOIC, its principles and 
tools. We aim to apply NCOIC’s products to our acquisition process to better define 
interoperability requirements and improve through-life systems integration prospects.” John 
McGarry, Australian Air Commodore. 

¢ "We have used NCOIC’s NCAT tool to assess levels of interoperability during NATO 
Response Force exercises. Our Centre of Excellence found the tool to be very useful in 
establishing the level of interoperability." Commander Fred van Ettinger, Section Head of 
the Multi National Command and Control Centre of Excellence. 


¢ “NCOIC has four characteristics which make it unique. The organization is solely dedicated 
to network-centric operations and interoperability; its membership stimulates discussions 
about global interoperability; it serves as a ‘vendor neutral’ forum, and it has a cadre of 
industry's top technical experts who are available to do its work.” Jack Zavin, U.S. Office of 
the Assistant Secretary of Defense, Networks and Information Integration. 


Relationships 


° Government Clauid Computing at the Tactical (Battlefi 
a mergency Response Levels — 
— Australia Defence Organization (ADO) a European Perspective 
— Eurocontrol 1A 
— European Defence Agency 
— NATO 
© ACT 
* NC3A 
* NCSA 


— Netherlands Command & Control Centre of Excellence 
— Sweden Civil Aviation Authority (LFV) 

— Sweden Defence Materiel Administration (FMV) 

— US Defense Information Systems Agency (DISA) 

— US Department of Homeland Security (DHS) 

— US Federal Aviation Administration (FAA) 

— US Joint Forces Command (JFCOM) 

— US NAVAIR 

— US SPAWAR 

— OSD(NII) 


¢ Organizational 


— Australia Defence Information & Electronic Systems Association (ADIESA) 
— NATO Industry Advisory Group (NIAG) 


2008 IDGA Award: 
— OASIS Outstanding Contribution 


— World Wide Consortium for the Grid (W2COG) to ihe Advancement 


of Network Centric Warfare 


NCOIC Key Deliverables 


Addressing Inter-Agency, Cross-Industry NCO Gg 


= Systems, Capabilities, Operations, Programs, & Enterprises (SCOPE) Model 
— Characterization of commercial, civil, and government requirements for interoperable systems 


= NCOIC Interoperability Framework™ (NIF) and Net Centric Patterns 
— Recommendations for open standards and their patterns of use to obtain interoperable systems 


= Building Blocks 
— Catalog of COTS & GOTS open standards based products compliant with NIF recommendations 


= Network Centric Analysis Tool™ (NCAT) 
— Netcentric analysis of system architectures, including System-of-Systems and Federation of 
Systems architectures 


= NCOIC Lexicon 


— Aglossary of terms and definitions that lay the foundation for meaningful discussions. Provides 
a common language for the disparity of ideas concerning key terms, including "NCO.“ 


= Systems Engineering best practices and processes 


— These best practices and processes include tools, process and maturity models, modeling 
techniques, and collaborative environments for NCOIC integration. 


These products, combined with NCOIC member expertise in NCO/NEC, 


measure netcentric capabilities ,requirements, gaps and provide 
recommendations for interoperability 


Sustained Effort to Make NCOIC Products 
Part of Procurement Process 


Advise Participate Adopt Require 
; ¢ NATO ¢ NATO C2COE NRF 
i alti — C3 IPT ~ NCAT 
Council ~NCAFT - USAF SPACECOM 
Members * DISA (US) — NCAT 
— CRADA ¢ FAA/Eurocontrol 
¢ US Defense — OSWG — SCOPE/NCAT/Pattern 
Science Board — NCAT S — | 
¢ OSD-NII (US) — FAA OTA 
_ NCAT * US DoD ¢ Aus DoD/RPDE 
— OSWG — Net-Centric 
— Cybersecurity Attributes 
¢ FAA/JPDO (US) ¢ Australian DoD 
— Aviation IPT — SCOPE/NCAT 
(NextGen/NEO) — Patterns/BBs 


NCOIC is Pursuing Plans to Further Increase Influence in Future 
Procurements 


NCOIC Terms 


¢ Network-Centric: 


— Related to systems and patterns of behavior that are influenced 
significantly or enabled by current and emergent networks and 
network technologies. Often these center around IP-based 
internetworking, but the term is sometimes used to include any type 
of enabling network. 


¢ Network-Centric Operations (NCO): 


— An information superiority-enabled concept of operations that 
generates increased combat power by networking sensors, decision 
makers, and shooters to achieve shared awareness, increased 
speed of command, higher tempo of operations, greater lethality, 
increased survivability and a greater degree of self-synchronization. 


Net-Centricity Requires Interoperability 


Lore) [oma lal islae) ol-re-le)i ay 


(DOD/NATO) The ability of systems, units, or forces to provide services to, 
and accept services from other systems, units, or forces and to use the 
services so exchanged to enable them to operate effectively together. 
(Joint Pub 1-02) 


¢ (DOD only) The condition achieved among communications-electronics 
systems or items of communications-electronics equipment when information 
or services can be exchanged directly and satisfactorily between them and/or 
their users. The degree of interoperability should be defined when referring to 
specific cases. (Joint Pub 1-02) 


¢ (NATO) The ability to operate in synergy in the execution of assigned tasks. 
(AAP-6 [2005]) 

¢ (IEEE) ... the ability of two or more systems or components to exchange 
information and to use the information that has been exchanged 

¢ (Wikipedia) Interoperability is connecting people, data and diverse systems. 
The term can be defined in a technical way or in a broad way, taking into 
account social, political and organizational factors. 


NCOIC Assists Customers 
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CUSTOMER I To AcHIEV SOLUTIONS TONEEDS WA casspi ine 
GOALS pg [OACHIEVE (EXISTING AND FUTURE) gg CAPABILITIES 
GOALS & SERVICES 


Typical Process Steps to Solutions: 


meoee == ° é S t 
NCO Initiatives Database —_) 4, Analysis of Alternatives bavered 
2. Requirements Derivation Quality 
SCOPE Model | | 3 Requirements Validation of Service 
NCOIC Interoperability Framework (NIF™) 4Baaen Synthesis Network 
N Centric 
C Analysis 
; ; = => Tool 
The Network Centric Analysis Tool A (NCAT™) 
(NCAT™) provides an assessment of T 
reaching interoperability goals Buildi 
. P a 5, DESIGN VERIFICATION Blocks 
6. Deployment (BB) 
7. Support 


8. Upgrade or Disposal 


Network Centric Analysis Tool (NCAT™) 


NCAT™ 


¢ The NCAT is an assessment tool to... 


— Provide a metric based approach to evaluating and measuring 
a system architecture’s “fitness” for operating in a net centric 
environment 


¢ NCAT focuses on areas of criteria, categories, compliance, 
and recommendations 
— Measures how well a target aligns with the areas of compliance 


¢ Criteria and metrics to measure their “goodness” are 
identified 


— Criteria can be grouped together into common categories (e.g. 
Information Assurance) 


— Criteria can be tailored to meet specfic needs 


Network Centric Analysis Tool [NCAT ™ 


Purpose 


¢ NCAT Supports 


Assessing compliance with specific architecture guidelines & ref 
models 


Selection of appropriate architectures 
Comparison between similar entities 
Implementation of SCOPE analyses 


« NCAT Use Cases 


Internal Program performs self-assessment 

Product Evaluation Engineer ranks similar products based on scoring 
results 

Project/program Manager monitors progress comparing planned and 
achieved behaviors 

Lead Systems Integrator (LSI) verifies Network Centricity compliance 
Acquisition Authority selects system/products based on assessment 

results 


Provides confidence that a system can operate in 
a network centric environment 


Who is using NCAT™ ? 


Network Centric Operations Industry Consortium (NCOIC™) 
— Net Enabled Emergency Response (NEER) IPT 
— Sense & Respond Logistics (S&RL) IPT 


— Member companies for new business 

¢ Member companies supporting FAA NextGen 

¢ North Atlantic Treaty Organization (NATO) 

¢ USAF Space Command (via Northrop Grumman) 
— Performing 100+ assessments 


¢ Interest being shown by members of the Australian 
Department of Defence, DISA and FAA 
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Questionnaire-based 


Tailorable Q&As by Program - Step 1 - Set Goals/ 


Collaborative & Web-enabled Expectations 


SQL-driven - Supports MS 
SQL, IBM DB2 and Oracle 
database servers 


Excel-to-XML data 

import & export 

Leverages web services for 
easy integration with third- 
party reporting applications 
Supports NCOIC 


SCOPE model ¢ Step 2 - Perform 


¢ Step 3- 
; Assessment 
Perform Analysis 


NCAT Terms 


¢ User attributes = Roles + Programs 
¢ Program (associated with a Survey) 
= Identifies the entity to be assessed 
= Partitions data between programs for privacy 
¢ Categories 
= Groups of Questions & Answers 
¢ Profile (has a Top Level Category) 
= A tailored set of Questions and Responses grouped by Categories 
¢ Survey = Program + (Assess1+Assess2+Assess x) 
= Sets Planned Values 
= Associated with Profile & Program 
= Survey - Aggregation of multiple assessments sharing common Profile for a 
single program 
¢ Assessment = User + Survey 
= Associated with User and Survey 
= Assessment is a single instance — one assessor, one set of questions 
¢ Reports 
= Single Assessment or Survey Report with multiple Assessments 
= Compares Planned vs Achieved 
= Export to Excel /other External Analysis Tools 
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Explanation 


Associated 
with Program 


NCAT Rights 


System 
Administrator 


Has technical skills. 


Has knowledge 
about Reports and 
data to 
import/export. 


Can 
create/edit/delete 
every NCAT entity 
such as Users, 


Programs, Profiles, 


and Surveys, etc. 
Can upload or 
delete Report 
templates. 

Can import/export 
every NCAT entity. 
Perform 
assessments. 
View Reports. 


Content 
Definer 


Defines database 
content used for 
surveys and 
assessments 


Create/modify/del 
ete 
Classifications, 
Questions and 
Answers. 

C/m/d Programs 
and Surveys. 
Upload or delete 


Report templates. 


Perform 
assessments. 
View Reports. 


Program 
Configuration 
Manager 


Administers programs 
and the surveys within 
these programs 


Modify/delete ONLY 
Programs, where the 
user is assigned with 
this Role to. 
Modify/delete Surveys 
where the user is 
assigned to the 
corresponding 
Program. 

Perform Assessments 
for Surveys, where the 
user is assigned to the 
corresponding 
Program. 

View Reports for 
those Assessments. 


Performs 
assessments for 
specific 
programs 


Perform 
Assessments 
for Surveys, 
where the user 
is assigned to 
the 
corresponding 
Program. 
View Reports 
for those 
Assessments. 


May receive 
some general 
information about 
what NCAT does 
- not clearly 
specified 


No specific rights 
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clearly in mind ! 


NCAT 
Demonstration 


NCAT - Engine Features 


¢ System 
— Split between tool and content 
¢ Technology 
— Web based Generic Features 
— 2versions using common data base structure 
¢ Access via Web 
¢ Stand-alone on Desktop 
— Database backed 
¢ Functionality 
— Taxonomy based evaluation 
— Multiple users, programs, schemes, profiles, and assessments 
— Response directed assessment 
— Program dependent weights, scales, and priorities 
— Progress tracking (planned, achieved, time series, snapshot) 
— Comparative (systems and phases) analysis 


— Extensive dynamic reporting — compliance, non-compliance, summary, 
detailed, various formats (tables and graphs) 


¢ Interfaces 
— Import/export XML data 
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¢ Spiral One 
— Based on: “Modular Open System Approach — Program Assessment 
and Rating Tool — DoD (AT&L/DS) - Joint Systems Task Force 
— EXCEL Spreadsheet evaluation via NII Net Centric Checklist 


¢ Spiral Two 
— A web based tool 
¢ Capable of handling multiple sets of criteria 
¢ Provide extensive reporting 


¢ Oriented towards design and implementation communities as well as the 
acquisition community 


¢ Spiral Three 


— NCAT content extended to cover all aspects of interoperability: 
¢ NCOIC SCOPE model 
¢ NATO Maturity Levels 
¢ DoD / NATO Net-Ready Key Performance & Interoperability Parameters 
(NR-KPPs / KIPs) 
¢ Other customer evaluation criteria 
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Ul Enhancements 


° Sortable tables (each column can be sorted) used in the overview pages, to include Profiles, Programs, 
Users 


° New text fields for editing pages offering better value validation, automatic sizing and calendar widgets 
° Improved assessment editing and performance 
— _ split plane for dragging a border between left/right area of screen 
— using dynamic trees for displaying and modifying categorization 
— popup window for showing contextual information 
° Progress bars/wait icons when generating a report 
° Value descriptions of question as small popup window 


Assessment Enhancements 
° Comment fields for each Answer 


° Ability to include new attribute for question (example Answer) and displaying it where needed using turn 
on/off button 


° Branching questions using an overview tree for displaying the different branches in editing mode 
° Implementing agent for transferring old database content to new database schema 


Usability Enhancements 

° Excel-to-XML data import/export 

° Supports MS SQL, IBM DB2 and Oracle database servers 

° Leverages web services for easy integration with third-party reporting applications 


Additional Enhancements 

° Option to add a keyword list to Profiles and setting a corresponding filter in the Profile view 

° Encrypting saved passwords 

° Server binds to all available |P-addresses when starting application within enterprise network 
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Scenario 1: Product Evaluation Engineer Ranks Products 


¢ Product evaluation engineer runs NCAT on multiple products with a 
common set of criteria. He produces a comparative report. He then ranks 
the products based on NCAT scores. Selection of the products guided by 
the NCAT scores depends on other factors. 


Scenario 2: Project/program manager Monitors Progress 


¢ The manager prepares a common set of criteria; runs NCAT at various 
phases of the project/Program. A comparison of the results shows the 
progress. 


Scenario 3: LSI verifies/assesses compliance 


¢ AnLSI engineer/manager, before integrating the vendor products runs 
NCAT to assure interoperability and integration. 


Scenario 4: Quality Check Engineer identifies root causes of failure 


¢ Quality Engineer runs NCAT to determine if the system meets the set 
Sst Root causes report is produced to identify and rectify possible 
ailures. 
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Scenario 5: Acquire System 


¢ System to be acquired is evaluated with a common set of criteria, 
which has a minimum level of acceptability. While identifying failure 
areas, NCAT gives a measure of acceptance/confidence. 


Scenario 6: Architect identifies standards 


¢ An engineer in charge of designing a net-centric system or its 
components creates an architecture with various views (i.e., SVs), that 
support a Technical View. He then evaluates it using NCAT and 
produces a guidance report. The report provides recommended 
applicable standards to improve the component's Net Centric 
characteristics. 


Scenario 7: Assess system maturity 

¢ Acompany developing a net-centric system assesses it against a 
maturity model that defines several levels of net-centric compliance. 
When compared to customer needs, this gives input to the 
development plans. 


NCAT™ - Methodology 


¢ NCAT™ focuses on compliance assessment using pre-defined 
questions and multiple choice responses 
— Identifies criteria and metrics to measure “goodness” 
— Measures how well a target aligns with the areas of compliance 
— Groups criteria into common categories like Information Assurance (IA) 
¢ First — define standard against which to measure compliance 
¢ Compliance Level determined by Assessor selecting using multiple 
choice responses with weighted scores to standard questions 
¢« Assessments structured by an administrator who crafts the questions 
and planned target results for the specific case. 
¢ Profiles developed by selecting applicable subsets of the available 
questions or creating new questions and responses 
¢ Assessment Results (individual or series) reported 
¢ Data Privacy maintained and not openly visible 


Asking the right people the right questions 


What are we measuring? 


Network Centric Attributes and Behaviors 


Attribute | Description 


Internet & World Wide Web 
Like 

Secure & available 
information transport 
Information Protection & 
Surety (built-in trust) 


Post in parallel 


Smart pull (vice smart 
push) 

Information/Data centric 
Shared Applications & 
Services 

Trusted & Tailored Access 
Quality of service 


Adapting Internet & World Wide Web constructs & standards with enhancements 
for mobility, surety, and military unique features (e.g. precedence, preemption) . 


Encryption initially for core transport backbone; goal is edge to edge; hardened 
against denial of service. 


Producer/Publisher marks the info/data for classification and handling; and 
provides provisions for assuring authenticity, integrity, and non-repudiation. 


Producer/Publisher make info/data visible and accessible without delay so that 
users get info/data when and how needed (e.g. raw, analyzed, archived). 


Users can find and pull directly, subscribe or use value added services (e.g. 
discovery). User Defined Operational Picture v Common Operational Picture. 


Data separate from applications and services. Minimize need for special or 
proprietary software. 


Users can pull multiple applications to access same data or choose same apps 
when they need to collaborate. Applications on “desktop” or as a service. 


Access to the information transport, info/data, applications & services linked to 
user’s role, identity & technical capability. 


Tailored for information form: voice, still imagery, video/moving imagery, data, 
and collaboration. 
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NESI [Net-Centric Enterprise Solutions for Interoperability) 
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This document is a NESI product. 
NESI (Net-Centric Enterprise Solutions for Interoperability) 
is a collaborative activity between the USN PEO for C41 

and Space and the USAF Electronic Systems Center. 


Net-Centric Implementation Framework 


Net-Centric Tenets 


¢ Data Tenets — Data/Application Team 
— Make Data Visible 
— Make Data Accessible 
— Make Data Understandable 
— Make Data Trustable 
— Make Data Interoperable 
— Provide Data Management 
— Be Responsive to User Needs 


Net-Centric Tenets 


¢ Information Assurance/Security Tenets — IA Team 
— Net-centric IA posture & Ops Continuity 
— ID management, authentication, privileges 


— Mediate Security Assertions 

— Cross-Security Domains Exchange 
— Encryption 

— Employ Wireless Technologies 


— Others — Integrity, Confidentiality, Intrusion detection 
& reporting, Audits, Policy Compliance, Certification 
and Accreditation (C&A) 


Net-Centric Tenets 


¢ Service Tenets — Enterprise Services Team 
— Service Oriented Architecture (SOA) 


— Open Architecture 

— Scalability 

— Availability 

— Accommodate Heterogeneity 

— Decentralized Ops & Management 

— Enterprise Service Management (ESM) 


Net-Centric Tenets 


¢ Transport Tenets — Transport Team 
— IPv6 
— Packet Switched Infrastructure 
— Layering and Modularity 


— Concurrent Transport of Info Flows 

— Differentiated QoS Management 

— Network / Inter-network Connectivity 

— RF Acquisition 

— Joint Net-Centric Capabilities 

— Ops & Management of Transport & Services 


Net-Centric Tenets 


¢ Data Tenets — Data/Application Team Service Tenets — Enterprise Services Team 
Make Data Visible — Service Oriented Architecture (SOA) 
Make Data Accessible Open Architecture 
Make Data Understandable 
Make Data Trustable 
Make Data Interoperable 
Provide Data Management 
Be Responsive to User Needs 


Scalability 

Availability 

Accommodate Heterogeneity 
Decentralized Ops & Management 
Enterprise Service Management (ESM) 


¢ Information Assurance/Security Tenets — IA Transport Tenets — Transport Team 
Team IPv6 

Net-centric IA posture & Ops Continuity Packet Switched Infrastructure 
ID management, authentication, privileges Layering and Modularity 
Mediate Security Assertions Concurrent Transport of Info Flows 
Cross-Security Domains Exchange Differentiated QOS Management 
Encryption and HAIPE Network / Inter-network Connectivity 
Employ Wireless Technologies RF Acquisition 
Others — Integrity, Confidentiality, Intrusion Joint Net-Centric Capabilities 


detection & reporting, Audits, Policy Ops & Management of Transport & 
Compliance, C&A Services 


Put together make up the majority of the questions 


NCAT Survey Steps 


Perform Analysis 


» Administrator creates a Profile to be used for a 


specific assessment 
¢ Step 1 - Set Goals/ . , : | | 
i " AProfile - selection of questions applicable to a 
Expectations Program 
» Administrator may adjust scores and weights at 


this stage 


» Administrator creates a Program that has a 
fixed set of Assessors using “Profiles” 


= Administrator creates a Survey from the profile 


«» Administrator sets threshold levels (called 
planned values) for each question with inputs 
from the team of stakeholders 


¢ Step 2 -— Perform 


Analysts generate reports on the results Assessment 


Assessment Report includes a comparison =  Assessor(s) answer Profile 
between the planned values and the actual questions in the survey for the 
assessed values for an individual assessment. ; 

artifacts being assessed. 


Summary Report aggregates and scores the 
responses of all individual assessments for the 
program. 


\ (O7-\y muda \V(cy-koeraslaatslalm@iv(siaalele 


Technologies =_— ai 
Implemented Element 


Verification/ 
Certification 
Use of cere 
Standards identified 


Governance 


Procedures Some 


Identified 


NON LOW PARTIAL SOME COMP- 
COMPLIANCE COMPLIANCE COMPLIANCE LIANCE, NOT ALL 
O 
0% 20% 40% 60% 


MOSTLY 
COMPLIANT 


80% 


NCAT uses a gradient scale 


FULL 
COMPLIANCE 


100% 


NCAT Assessment Reports 


— P D F, HTM L, M S Wo rd ef Cc Cj [ Cc Network Centric Operations Industry Consortium 


x User:.nc 
| re ‘gel an OO cide 
bee, emeeld ——. Network Centric Operations Industry Consortium 


Home > Report Templates 
.NCAT™ User:.ncat 


NCAT™ overview 


< back 


E tType: PDF HTML Word 
Users Create, edit and delete users ne er 


Assessments 


Programs Create, edit, delete a program 


My Fourth Assessment 


Categories, Questions and Answers 


Profiles Create, edit, delete profiles which are based on cop 
The content definer may tailor categories, question 


Create, edit, delete a category; create, edit, delete My First Assessment 


My Second Assessment 
My Third Assessment 
NDIA_Assessor - NDIA Survey 


Surveys Create, edit, delete a surveys by assigning a profile 


View and delete assessments 


Assessments 
ncat_administrator - NDIA Survey 
© Copyright 2007-2010 NCOIC - All Rights Reserved [Logout] 


References Create, edit and delete references 


Guidances Create, edit and delete guidances 


Perform Assessment for Survey: -- select survey -- = 


i Generate Report from Report Template -- select report -- ’ 


-- select report -- 
Report Templates NCAT_Report_Assessment 


NCAT_Report_Survey 
Import Data Excel_NCAT_Report_Basic_V2.0 


Export Data Export all NCAT entities to data file 


© Copyright 2007-2010 NCOIC - All Rights Reserved [Logout] 


NCAT Assessments and Scores 


Tertal Tertal 
=» 25 Total Questions Guests Nat ote 


Questions Se nike Oreited . _ Peed 
Aneh tect re 2 


=" Max possible achkued 
score = 25 x Opes Arci tect re Planned 
Acheved 

100 point per — 
question = Scabnity ne 


Pee cl 


cha Aca Iba thy 7 
= Planned 38.4% schkved 
= Achieved 76% Platalte CA ’ — 
=" Does not have cease 


Ene rpree Se ruice P len be cl 
to approach poesia achkued 
max, just meet 


Phanne cl 
Comblied Rating 1 


or exceed ° ” aera 
planned 


‘CONTENT2.11 SPIDER VECTOR SURVEY 


OPS and MGMT VIEW 


mt as planned 
mt achieved 


ee EES 


SERVICES VIEW SECURITY VIEW 


DATA VIEW 


NCAT Provides Simple Content Import 


OFT ale =p Cor] 


¢ Enable Macros in Excel 
¢ Follow Instructions on Worksheet 1 


s) | led * 100210NCOIC_NCAT_Content_Template [Compatibility Mode] - Microsoft Excel - xX 
+| a = 
@ Beck = ee Pagelayout Formulas Data. ‘Review. «View. ~—= Developer. «Add-Ins. «(Acrobat @-ox 
Address |@> = & cut . To =a = = Port = AutoSum ~ 3 
Arial - 10 General ; = I | cm CK et Ay = ES 
Folders ‘B fhycopy si gs PAA | = zt aioe vA ww 
= ||| Paste [ip zee || ye A. =| = A beer = ~ % > || %aB 293], Conditional Format — Cell Insert Delete Format | Sort& Find&  ShareAs WebEx 
+ Md > -F Format Painter ed = ad oat FSF) | Sid Merge 8 Center ~ || ayes 2 || ee es as Table~ Styles || . ~ || <2Clear= Filter Select~ Application Settings 
a 
B Clipboard EI Font FI Alignment Fy Number fa Styles Cells Editing WebEx 
S Gall . x 
@ Security Warning Macros have been disabled 
a) as 7 | ; = = ; — ae 
= A B c D E E G H | J K L M N 
, Set Wert bold Level 1 Level 2 Level 3 Level 4 Level5 Question _ Export to Answer NCAT Description |Example Guidance Reference |Weight| Scale 
1.0.0.0.0.0.0.1.1 OPS and MGMT d2 e2 g2 2 
z VIEW 
—/1.1.0.0.0.0.0.1.1 OPS and MGMT Situation Awareness d3 e3 g3 3 
VIEW. (SA) 
1.1.1.0.0.0.0.1.1 OPS and MGMT Situation Awareness |Situation d4 ed g4 4 
4 VIEW {SA} [Awareness (SA) 
1.1.1.1.0.0.0.1.1 OPS and MGMT Situation Awareness | Situation Situational d5 e6 g 5 
al 5 VIEW. (SA) Awareness (SA) Awareness 
ao 1.1.1.1.0.1.0.1.1 What is the ability to d6 26 g6 6 1 
za@ obtain cassis 
1 OPS and MGMT Situation Awareness |Situation Situational SENT e: ty om F 
e VIEW (SA) Awareness (SA) Awareness Oppeaina Hore yr Foe 
' example. opposing 
=) forces location/ 
2) 6 intentions. 
oe 4.1.1.1.0.1.1.1.1 OPS and MGMT Situation Awareness |Situation Situational Not able to obtain situation d7 e7 gv 7 i 
Sa] 7 VIEW (SA) [Awareness (SA) Awareness awareness 10 
1.1.1.1.0.1.2.1.1 OPS and MGMT Situation Awareness | Situation Situational Very difficult to obtain situation d3 ed g8 i] feo 
8 VIEW (SA) [Awareness (SA) Awareness awareness 
1.1.1.1.0.1,3.1.1 OPS and MGMT Situation Awareness | Situation Situational Somewhat able to obtain adequate |d9 eg go ce] if 
g VIEW (SA) Awareness (SA) Awareness situation awareness 30 
4.1.1.1.0.1.4.1.1 OPS and MGMT Situation Awareness | Situation Situational Easy to obtain accurate situation d10 e10 g10 r10 \ 
10 VIEW (SA) [Awareness (SA) _|Awareness awareness 40 
1.1.1.1.0.2.0.0.0 \s it possible to 
= OPS and MGMT Situation Awareness |Situation Situational eae ceeded 
VIEW (SA) [Awareness (SA) Awareness oe } Ing 
coherent and time 
1 sensitive? 1 
1.1.1.1.0.2.1.0.0 OPS and MGMT Situation Awareness | Situation Situational eis vot r 
12 VIEW. (SA) Awareness (SA) Awareness [10 
ERTIO2 20D OPS and MGMT Situation Awareness |Situation Situational Kes “e eons eae ae i 
2 VIEW (SA) Awareness (SA) Awareness aCe iS eres 8 NOR Post RS 
13 information exchange 
1,1.1.1.0.2.3.0.0 Yes, but the whole recognised air if 
OPS and MGMT Situation Awareness | Situation Situational pictures mpastedtin a nen seAl Gines 
NEW f se ' information exchange within 20 
VIEW (SA) Awareness (SA) Awareness ps 
minutes for 70 percent of 
14 ———— occurrences 
44 > >| Instructions | NCOIC NCAT Content .“ User Defined Content. i 4 | 
Ready fal 


NCAT - Engine Features 


¢ System 
— Split between tool and content 
¢ Technology 
— Web based Generic Features 
— 2versions using common data base structure 
¢ Access via Web 
¢ Stand-alone on Desktop 
— Database backed 
¢ Functionality 
— Taxonomy based evaluation 
— Multiple users, programs, schemes, profiles, and assessments 
— Response directed assessment 
— Program dependent weights, scales, and priorities 
— Progress tracking (planned, achieved, time series, snapshot) 
— Comparative (systems and phases) analysis 


— Extensive dynamic reporting — compliance, non-compliance, summary, 
detailed, various formats (tables and graphs) 


¢ Interfaces 
— Import/export XML data 


(O72 Made Dela} Corsten Mal al 4 


¢ Download link for NCAT and related Material 


http://ncoic.cachefly.net/Java/java.zip 


|] WinZip (Unregistered) - NCAT_Buildi50_Oct2010 ja 
File Actions Options Help 


©&evV CGEvEGa SG 


New Open Favorites Add Extract View CheckOut Wizard 
[Name ®—“‘“‘CS™SCS*S*SCSCSCSS Sze | Path 
1) 100210NCOIC_NCAT_Content_Template.xls 563,200 NCAT_Content\ 
&) 100210NCOIC_SCOPE_Content_Template.xIs 330,240 NCAT_Content\ 
1,332,767 NCAT_Content\ 
1 -doc | 92,160 
™)How_to_use_the_| NCAT Tool - v3.1_Build_150_20100507. df 67,280 
a] installationandstartreadme3_1.txt 1,625 
Licenses and Copyrights of used modules.xls 26,624 Documents\ 
S)NCAT Evaluation Form20091118.x\s 36,352 Documents\ 
NCAT Install and QuickStartV3_1_Build150_20100507.doc 1,952,768 Documents\ 
NCAT Java 3 THIRD PARTY SOFTWARE and LICENSES.doc 170,496 Documents\ 
NCAT License Agreement.DOC 41,984 Documents\ 
&)NCAT Report Generator Spider Diagram_V3.1_for_Build_150.xls 179,200 Documents\ 
@)NCAT_OverviewV3.1Build150_20100426.ppt 2,238,976 Training\ 
FINCAT_RTL-NCAT_V3.1_Build150-Setup.exe 128,500,... 
@)NCAT_UserGuideBuild150V3_1_20100507.ppt 6,721,024 Training\ 
4) NCAT_V3.1_NewFeatures20091118.doc 63,488 Documents\ 
E) readmejava3zip.txt 1,435 
(Sl Services.xml 106,493 NCAT_Content\ 
‘ > 


Selected 0 files, 0 bytes Total 18 files, 139,089KB OVy 


Lore) [oat] M-y:Vaaliale mi feke lel (ers 


Network Centric Operations Industry Consortium eLearning Modules 


Network Centric Assessment Tool (NCAT ™) Overview 


https://www.ncoic.org/technology/activities/education/elearning/ 
Network Centric Operations: The Fundamentals 
The Role of NCOIC Deliverables 


systems, Capabilities, Operations, Programs, and Enterprises (SCOPE) 


Model Overview 


NCOIC Interoperability Framework (NIF™) and NCOIC Patterns 


Overview 


Building Blocks Database Overview 
Export Compliance Overview 


On Line Training Materials 


Summary 


¢ NCOIC is developing a family of Network Centric Tools for 
understanding net-centricity and interoperability 


¢ NCOIC provides NCAT to interested stakeholders 
¢ NCAT can be tailored for: 


— Program specific profiles of selected questions 
— comparison of planned vs actual assessments 
— Privacy of program-specific results 
¢ NCOIC requests feedback in return for using NCOIC 
products. 
— Feedback will be used to improve future versions only. 
— Your feedback will not be shared openly. 


Net-Enabled == , 
Future . f ah 


Stove-piped 
Systems, — 


NCAT 
Tutorial 
Reference 


NCAT Engine Tutorial 


¢ In order to better understand NCAT, the following provides a short tutorial 
ona small subset of the NCAT questions. 
— The subset is entitled “Services” which has 25 questions 
¢ The user will download the Java Zip files and install the NCAT program 
¢ The user will log in as the “ncat_administrator” & do the following: 


setup a new User Account for “John Q Services” (username “Services”, 
create a new Program called “Services Program’, 

create a new Profile called “Services Profile’, 

create a new Survey called “Services Survey”, 

set Planned Values, log out 


e The user will log in a second time as “Services”: 


perform the assessment answering 25 questions 


— Run some reports and examine them 


Olay Ay om dalsmil (sme) am dal-m ater) maar-level lal 


¢ Double Click on the .exe file to install 
¢ Automatically places files in C:\NCAT RIL 
¢ Goto C:\NCAT RTL to start NCAT 


& C:\Documents and Settings\mbeaufoWy Documents\NCOICANCAT Java\Cachefly Download\java 
File Edit View Favorites Tools Help rid 


es - . iF J. Search > Folders (Fas) 


Sddress EQ c: \Documents and Settings\mbeaufo\My Documents\NCOIC\NCAT Jayva\Cachefly_Download\java v Go 


: ™)| Name - i Type Date Modified 
File and Folder Tasks (Mec File Folder 7/6/2008 9;25 PM 
make anew Falder (| NewContentFiles File Folder 7/7/2008 3:19 PM 

\ Jreports2008-01-15 File Folder 7/6/2008 9:25 PM 
® ape ag Folder to > content204 xml 631 KB XML Document 12/13/2007 12:19 PM 

E? mea this Folder ie ne sca _package_Java_r1,doc 67 KB Microsoft Word Doc,., 6/10/2008 12:35 4M 

NCAT Evaluation Form_ri.xls 27 KB Microsoft Excel Wor... 6/10/2008 12:34 AM 
WNCAT Java THIRD PARTY SOFTWARE and LICENSES. doc 177 KB Microsoft WordDoc,., 2/1/2008 11:48 4M 

Other Places Wi NcaT License Agreement.DOC 41KB Microsoft WordDoc... 2/1/2008 11:47 4M 

scat eRe aren eae doc 1,925KB Microsoft WordDoc,., 4/8/2008 7:58 4M 

(ce ScheFly_Download er Diagram. xls 111KB Microsoft Excel Wor... 5/26/2008 11:13 PM 

(3 fy Documents ild130_ncoic.exe 84,224 KB Application 5/26/2008 10:52 PM 

P) My Computer E : SKB Text Document 7/6/2008 9:34 PM 
fe] reschneinvedb. txt 3KB Text Document 6/10/2008 12:35 4M 

“ My Metwork Places 


Ss) f: 1 (OF tom DY-] g0\¥a Dr-lr-Vey-t-y- 


¢ 1.Double Click on 1-Start_Apache Derby _DB.bat 


¢ Wait for the command box to report “started and ready to 
accept..” 


File Edit ‘Yiew Favorites Tools Help 


Ft _/ Search y- Folders sane 


Seidpess (EQ C:\NCAT_RTL 


6a 
Folders x Name Size Type Date Modified 
43 Desktop 1 Easoftwore File Folder 5/23/2008 9:14 PM 
+ rm | My Documents 1KB MS-DOS Batch File 3/18/2008 7:29 4M 
= ¢ My Computer [|] LPCONrgareKVeras Gran 1KB SH File 3/26/2007 : 3:25 4M 
5) ae Local Disk (C:) PF]i-start_Apache_Derby_DB.bat 
its ; |] 1- Start_Apache_Derby_DB,sh JAUA_HOME: C:\NCAT_RTL\Software\jdki .5 .6_67 
(2 applist =< DERBY_HOME: C:\NCAT_RTL\Sof tware\db-derby-18.0e0=8™ 
45 Fr fez Start_JBoss. bat Apache Derby Network Server — 10.2.2.6 —- @485682> star ted and ready to accept cop 
\ apps lade Innections on port 1527 at 2008-07-15 61:G3"08.152 GMT 
#4 9 cmdcons *|: h 
( Config.Msi = 
#4 (5 csv |= | README, txt 
4 C4 Documents and Settir 
#4 (> Drivers 
_) epa.epa 
H GD 1386 
#) (> Intel 
(3 msocache 


(5 NCAT_RTL 


Start NCAT - JBoss 


e 

= «6 , 3 
¢ Wait for “Started in xx s 
& ( NCAT RIL 
File Edit ‘Yiew Favorites Tools Help 

eI Search 4 Folders | |=s5|* 

ocldeess (EQ C:\NCAT_RTL 
Folders x Name 
Desktop (Software 


(3'10-confiqure_variable. bat 
4] 0-configure_variable.sh 

id] 1-Start_Apache_Derby_DB.bat 
1-Start_Apache_Derby_DB,sh 


# (i) My Documents 
> ¢ My Computer 
= Se Local Disk (C1) 
() applist 
#4] (>) apps 
( cmdcons 
(5 Config.Msi 
#5 c¥ 
#) (65) Documents and Settir 
(> Drivers 
_) epa.epa 
# 1386 
(5 Intel 
(| ms0Cache 
[3 NCAT_RTL 


2. 


+) 
z al ENC AT. “Installation9SGuidePavoneRi[1] 
=| README.txt 


<4 


| & 


2. Double Click on 2-Start_ JBoss.bat 


Size Type Date Modified 
File Folder 5/23/2008 9:14 PM 
1KB MS-DOS Batch File 3/18/2008 7:29 4M 
1KB SHFile 3/26/2007 3:25 4M 
1KB MS-DOS Batch File 11/8/2007 6:05 4M 
1KB SHFile 3/26/2007 3:36 4M 
g 


26:64:43,246 INFO 
VATELE SE Ses ee a) 8) 
4 .6:8693 

~324 INFO 


[testQueue] Bound to JNDI name: queue/testQueue 
CUILServerILService] JBossMQ UIL service available at 


[DLQ] Bound to JNDI name: queue/DLQ 

A‘ 204: 43.480 INFO [ConnectionFactoryBindingService] Bound ConnectionManager ’ jb 
oss .jca:service=Connect ionFactoryBinding.name=Jms&A’ to JNDI name ’ java: JmskA’ 
26:64:43,715 INFO [TomcatDeployer] deploy. ctxPath=/jmx-console. warUrl=.../dep 


eee ba console .war/ 
~-346 INFO [TomcatDeployer] deploy. ctxPath=/ncat., ./tmp/dep lo yf 
module 


warUrl=.. 
-Wwar/ 
[TilesPlugin] Tiles definition factory loaded for 


[NCATSessionStrutsPlugin] 
[NCATSessionStrutsPlugin] 
[NCATSessionStrutsPlugin] 


C[HttpiiBaseProtocol] Starting Coyote HITP/1.1 on http-@.0.6.6 


[ChannelSocket] JK: ajp13 listening on /@.0.6.6:86089 
C[JkMain] Jk wunping TD=8 time=8/78 confi ull 
- ester! JBoss (MR Microkerneél™=24.9.5.GA Cbhuild: CUSTag=Bran 
_4 @ date =2@616162339>] Started in 33s:669ms 


SJalatemeyomul(cjomelge)WVt-] merilale 
“http://localhost:8080/ncat!” 


‘@ NCAT™ - Microsoft Internet Explorer Seles 
File Edit View Favorites Tools Help : 


G sex > es | ' _y | Search sie Favorites &) oy a > jw] load co ZA clip Book a | rel | 
Add 2) http: /flocalhost:8080/ncat} 


v E} oo Links 7? 


Liser. ARonymouUs.|.Role; 


WELCOME TO THE NET CENTRIC ANALYSIS TOOL (NCAT™)! 


The Net Centric Analysis Tool (NCAT™) provides a quantifiable assessment of Net Centric Readiness for a program or system. Initially, the 


NCAT is focused on providing a method to quantifiably measure Net Centric behavior as it has been mandated by the NCOW RM - Net 
Centric Checklist. 


i 


login to work with the tool Username: 


Password: [ 


See available reports 


NCAT™ Jaya® edition version 2.2 build 130 04/07/2008 


(© Copyright 2007,2008 NCOIC - All Rights Reserved 


© 4 Local intranet 


Login as “ncat_administrator” 
using password “ncat” 


File Edit Yiew Favorites Tools Help 


@& NCAT™ - Microsoft Internet Explorer Seles 
” 


G sek > . ; ) y-| Search Sie Favorites & J 2. = sir | dT lea ua ES cin Pat | id, 8 


Adatess #) http: //localhost:8080/ncat/ ¥ Go 


liglee 2? 
Links 


r= 7T_ oI Tr 
| ee ae) 


= "Network Centric Operations Industry Consortium 
NCATE Liser:. Anonymous..|..Role; 
WELCOME TO THE NET CENTRIC ANALYSIS TOOL (NCAT™)! 


The Net Centric Analysis Tool (NCAT™) provides a quantifiable assessment of Net Centric Readiness for a program or system. Initially, the 


NCAT is focused on providing a method to quantifiably measure Net Centric behavior as it has been mandated by the NCOW RM - Net 
Centric Checklist. 


i 


login to work with the tool Username: 


incat_administrator 
Password: | eec| 


See available reports 


NCAT™ Jaya® edition version 2.2 build 130 04/07/2008 


(© Copyright 2007,2008 NCOIC - All Rights Reserved 


© 4 Local intranet 


Examine NCAT™ overview (HOME) 


@ NCAT™ - Microsoft Internet Explorer 


File Edit View Favorites Tools Help 


Go Back + / x) Ey + J Search i> Favorites & . pm (inal ao eacin Book S| i ie] 
Address &) http: jlocalhost:8080/ncat/login.do;jsessionid=71B92D302B900F jy User attributes = Roles + Prog rams 


¢ We will inspect 


each "ig [eet os | cmap I ee Program (associated with a Survey) 
— Users « Identifies the entity to be assessed 
7 Partitions data between programs for 
— Programs pier y 
7 ri 
= Categories was Create, edit and delete L Catego es ; 
. Programs Create, edit, delete a prc : goxee of Questions and Responses 
— Profiles *s. Profile (has a Top Level Category) 
Categories, Question’ and create, edit, delete a cat » A tailored set of Questions and 
Answers < 
~ Surveys (set Profiles Create, edit, delete profil Responses grouped by Categories 
he content definer ma 
planned) Surveys a tte delete a i Survey a Prog ram + 
— Assessments Assessments View and delete assessn (Assess1 +Assess2+Assess x) 
References Create, edit and delete r : sets Planned Values 
— References Euldsnces Lisidin, acl atet daketary = — Associated with Profile & Program 
. ; » Survey - aggregation of multiple 
— Guidelines Berform Assesswent for system Short List Vector assessments sharing a common 
a soe eee Profile for a single program 
Ly 7 y¥stem Vector les ury 
Ad Then We will: CONTENT2.11 SPIDER vem! Assessment = User + Survey 
eee OR ose = Associated with User and Survey 
— Perform an piste Rathi RAN eae Gio dessa = — Assessment is a single instance — 
assessment Template Devin ican tisgtbect one assessor, one set of questions 
Excel NCAT Report Basil Reports 
— Generate Reports sca ie iota = Single Assessment or Survey Report 


Import Data Import NCAT entities fron with multiple Assessments 

Export Data Export all NCAT entities t = Compares Planned vs Actual 

7 Export to Excel or other External 
Analysis Tools 


Import / Export Data 


— Analyze Results 


Click on “Users” 


© Copyright 2007,2008 NCOIC - All Rights Reserved 


Examine NCAT™ overview (HOME) 


¢ We need a Naming Convention to create each 
definition and know it is the right one for us 


— User named “Services, John Q.” 

— Program “Services Program” 

— “Services” Category already exists 

— Profile “Services Profile” 

— Survey “Services Survey” (set planned values as 
admin) 

— Assessment — Note you can “View and delete” 

— Reference “Services Reference” 

— Guideline “Services Guideline” 


¢ Then we will: 
— Logout as “ncat_administrator” and login as “Services” 
— Perform an assessment of the “Services Program” 
— Generate Reports on Single Assessment 
— Analyze Results 


Setup User 


Pick “Services” 
Naming 
Convention first 


Fill in mandatory 


fields 


Have not set up 
Program yet so 
cannot assign 
role/program 
relationship 


Make sure you 
check the 
“Account is 
active” box. 
Save 


Come back later 
to add Progra 


Click on “Home” 


‘@ NCAT™ - Microsoft Internet Explorer 


File 


(<) Back + 


Addpess #@) http: #localhost:8080/ncat/useredit.do 


Edit View Favorites Tools Help 


Eel) 
& 


ix] \2] v, _)-| Search sip Favorites &) ‘+ as > |) - lal co gE clip Book Ee] rel 3 


| 4 Go 


"om Y ced ome 1 1 coir 
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CATE 


Phone: 


Fax: 


Cell: 


Email*: 


Address: 


Roles in 


General 
Roles: 


Created: 


Users > Edit user 


UserID*; 


First Name: 


Last Name*; 


Programs: 


Accountis {—} 
active 


Changed: 


User mcat.administraton Role. Syster 


Services 


Password*: eesee 


John Q, 


Services 


Organization: SOA 


(972) 123-4567 


(972) 765-4321 


John_Q_Services@Raytheon.com 


Mail Code at McKinney, TX 


| delete > 


General Roles: ~ | add > 


delete > 


0 
Q 


* - Fields are mandatory 


©4 Local intranet 


Confirm User “Services” is created 


¢ Confirm on Users screen. 
¢ Then Click on “Home?” link. Then Click on “Programs?” link. 


ie 
7 


™ NCAT Microsolt fernet Explor x] | 


File Edit View Favorites Tools Help v 
7 | 
. 4 ; ; - a a yl + : in Book  |aae 4 &y 
Oo Back . m| \w| ey Search vr Favorites & - wy] Lad ge Clip Book fag. | ‘sl us | 
Adress |} http:/flocalhost:8080/ncat/main.do?action=userAdmin v Go Links”? 


Liser, ncat administratar. | .Role. System.Administratar 


Choose: 

Users [New user] Name Organization Actions Exp. 

PCM ProgramConfiguration Manager PCM Org [edit] [delete] [| 
John Q. Services SOA [edit] [delete] | [| 

admin Michael Admin Beauford NCAT FT [edit] [delete] [] 

neat_administrator Mike Beauford, CD, PCM NCAT FT xxx [edit] [delete] | [| 


&) Done ©4 Local intranet 


Setup Program 


¢ Follow the “Services” Naming Convention 
¢ Click on New Program to create a new “Services Program” 


’ 
—— Network Centric Operations Industry Consortium 


Usen ncabadministratan.|.Rolen System.Administratar 


Home > Programs 


Choose; 
Programg¢ [New program] Description Organization Actions Exp. 
CONTENT2.11 SPIDER VECTOR PROGRAM - NCAT FT [edit] [delete] [] 
Data SPIDER Program - NCAT FT [edit] [delete]| [) 
NCAT SPIDER Vector Program - NCAT FT [edit] [delete] [] 
System Vector Test Program System Vector Test NCAT FT xx [edit] [delete], [] 
« back _JExport NCAT entities without referenced entities | Export 


@) http: //ocalhost:8080/ncat{programedit.do ©9 Local intranet 


Fill in “Services Program” details 


Name it 
“Services 
Program” 


¢ Fill in Mandatory 
Fields 


¢ Skip References 
for now 


¢ Note no Surveys 
are filled in 


¢ Click on 
“Program is 
active” 


¢ Click on “Save” 
¢ Click on “Home” 


| Program is active [v]: 


Liser. Acatadministrator|.Rolen Sy 


Programs > Edit program 


ProgramID*:; Services Program 


'This is a assessment of Services. 


Purpose* (max. 
2000 characters): 


This is a description of the Services Program. 


Description (max. 
2000 characters): 


Organization*: NCAT Functional Team 


Reference: 


Created: () 
Changed: () 


) * -Fields are mandatory 


Associate Program with User 


¢ From “Home’ Click on “Users” 
¢ On the “Services” row, Click on Edit under “Actions” 


=m 
——— Network Centric Operations Industry Consortium 


Liser. ncatwacdministratore|.Role. Systemn.Administraton 


Home > Users 


Choose: 

Users [New user] Name Organization Actions Exp. 
PCM ProgramcConfiguration Manager PCM Org [edit] [delete] [J 
Services John Q, Services SOA C Test Puetete) ie 
admin Michael Admin Beauford NCAT FT [edit] [delete] | [J 
neat_administrator Mike Beauford, CD, PCM NCAT FT xxx [edit] [delete] [] 
< back CJExport NCAT entities without referenced entities | Export | 


© Copyright 2007,2008 NCOIC - All Rights Reserved [Logout] 


Associate Program with User 


Mmcc 


MCAT 


Click on “Role” 
pull down 
— Select “Assessor” 


Click on 
“in_ Program” 
down 


— Select “Services 
Program” 


— Click on “Add” 


UserID*: 
Password*: 
First Name: 
Last Name*: 
p U | | Organization: 

Phone: 
Fax: 
Cell: 

Email*: 


Address: 


Roles in 
Programs: 


General 
Roles: 


Account is 
active 


Created: 
Changed: 


Home > Users > Edit user 


(oo 
Sa Network Contric Operations Industry Consortiom 


Services 

coco 

John Q, 

Services 

504, 

(972) 123-4567 

(972) 765-4321 

(972) 412-6001 
John_Q_Services@Raytheon.com 
Mail Code at McKinney, TX 


Role: ~ in Program: 


ae === Manager 


General Roles: 


| delete > 


neat_administrator (2008-07-14 20:28:23,371) 
neat_administrator (2008-07-14 20:38:52,59) 


* - Fields are mandatory 


(Save ] | Cancel | 


“|CONTENT2.11 SPIDER VECTOR PROGRAM 


~ || add > | 


Userencatwadministratans) Role. S¥ 


¥) (22>) 


Data SPIDER Program 
NCAT SPIDER Vector Program 
Services Program 


System Vector Test Program 


Associate Program with User 


ncoic 


—— Network Centric Operations Industry Consortivm 


NCAT ser ncateagministratone|.Rolen Si 


C{ tome >) sers > Edit user 


UserID*:; =| Services 


Password*: |eeee 
First Name: John. 
Last Name*: |Services 


Organization: |SOA 


Phone: (972) 123-4567 
Fax: (972) 765-4321 
Cell: (972) 412-6001 
Email*: John_Q_Services@Raytheon.com 


Address: Mail Code at McKinney, TX 


Role: | Assessor * in Program: | Services Program ~| [ add > | 
of, 4 Se 
Programs: 
¢ Observe update to a 
Ldelate | 


“Roles in Programs’ eat 
General Roles: v | add > 
concatenates 
“Assessor” — eels 
“Services Program” faases 
¢ Click “Save” returns | *scut’ 
to “User” list eae e 
* Click “Home” * - Fields are mandatory 


Setup Profile Next 


Since 
“Services” 
Category 
was already 
available, 


we will 
createanew > 


NCAT! 


NCAT™ overview 


Programs 


Categories, Questions and 


Answers 


D Surveys 
Profile next. Ackedsinbhts 
e i References 
Click on Guidances 


“Profiles” 


Perform Assessment for 
Survey: 


Generate Report from Report 
Template 
Report Templates 


Import Data 
Export Data 


— pr = 

| LS fh Network Centric Operations Industry Consortium 
bab 

| 


Create, edit and delete users 


Create, edit, delete a program 


Create, edit, delete a category; create, edit, delete questions and answers 


Create, edit, delete profiles which are based on copies of categories containing questions and answers. 


The content definer may tailor categories, questions and answers of a profile, 
Create, edit, delete a surveys by assigning a profile to a program 


View and delete assessments 


Create, edit and delete references 


Create, edit and delete guidances 


System Short List Vector Test Survey System Short List Vector Test 

NCAT SPIDER Vector Survey - 

System Vector Test Survey - 

CONTENT2.11 SPIDER VECTOR SURVEY This survey is to establish the SPIDER VECTORS, 
Data SPIDER Survey Data SPIDER SURVEY Description. 


NCAT Report Assessment 
NCAT Report Survey 
Excel NCAT Report Basic V2.0 


Upload, delete report templates 


Import NCAT entities from data file 
Export all NCAT entities ta data file 


'© Copyright 2007,2008 NCOIC - 4) Rights Reserved 


Liserancak administrator.) Roleniysten Administrator 


[Logout] 


Setup New Profile 


¢ Actions include “modify assigned C/Q/A*” (discussed later) 
— C/Q/A = Categories, Questions, Answers 


¢ Click on “New Profile” 


‘an end tens | ea 
we ee FL Network Centric Operations Industry Consortium 


NCAT Wsernancak administrator. | RolenSysten, Scimins trator. 


Home > Profiles 


Choose: 


Profile [New profile] Actions Exp. 


CONTENT2.11 SPIDER VECTOR PROFILE [edit] [delete] [modify assigned C/O/A] SI | 
Data SPIDER Profile [edit] [delete] [modify assigned C/o/4)] |) [] 
NCAT SPIDER Vector Profile [edit] [delete] [modify assigned c/o/a) ) (J 
System Vector Test Profile [edit] [delete] [modify assigned C/O/A] J 
<= back CIExport NCAT entities without referenced entities | Export | 


° Copyright 2007,2008 NCOIC - All Rights Reserved [Logout] 


2) ®2 Local intranet 


Create New “Services Profile” 


Network Centric Operations Industry Consortivm 


Name new 


NCAT™ 


profile “Services me > Prafiles > Bait profile 


Profile” 


Fill Mandatory 
Fields 


Click on pull 
down for 
“Assign Top 
Level Category” 


Click on Profile * - Fields are mandatory 


is active” = Ge) (cana 


Click on “Save” 


Description (max. 2000 
characters): 


Assigned Top Level 
Category*: 


Reference: 
Profile is active 


Created: 
Changed: 


Profile name*: Services Profile 


|Description of the Services Profile. 


SYSTEMS VIEW 

SYSTEMS VIEW 

NCAT SPIDER Vectors 

NCAT Content2,10 

SPIDER 20080708 

NCAT Content2,11 

OPS and MGMT VIEW 

SECURITY VIEW 

Information Assurance / Security (14) 


Manageability 
Architecture Dependency 
Autonomics 


© Copyright 2007,2008 NCOIC - 4ll Rights Reserved 


takes us back to 
“Profiles” page 


User tcatadministraton, |, Role. System Administrator 


[Logout] 


Confirm new “Services Profile” 


¢ Confirm creation of new “Services Profile” 
¢ Click on “Home” 


™ 
Network Centric Operations Industry Consortivm 


NCAT User. ocatadmunistrator.|. Roles system Administrator 


Home > Profiles 


Choose: 
Profiles [New profile] Actions Exp. 
CONTENT2.11 SPIDER VECTOR PROFILE [edit] [delete] [modify assigned C/o/A]) OO) 
Data SPIDER Profile [edit] [delete] [modify assigned c/O/4s] [J 
NCAT SPIDER Vector Profile [edit] [delete] [modify assiqned c/o/é] [ 
[edit] [delete] [modify assigned c/o/a], 0 
System Vector Test Profile [edit] [delete] [modify assigned C/o/é] |) [J 


< back CExport NCAT entities without referenced entities | Export | 


Setup New Survey 


¢ Observe Actions include “set planned values*” 
(discuss later) 


¢ Click on “New Survey” 


oo | ond om (cc 
FD Ces: Set Fee, Network Centric Operations Industry Consortinm 


NEAT Liser. ncaladministrator.|,.Role: system Administrator 


Home > Surveys 


Choose: 
Surv “Vs [New survey] > Description Actions Exp. 
nie Survey System Short List Vector Test [edit] (delete[ [eet planned values) C] 
NCAT SPIDER Vector Survey - [edit] [delete] [set planned values] [_] 
System Vector Test Survey - [edit] [delete] [set planned values] |» [1] 
CONTENT2.11 SPIDER VECTOR SURVEY = This survey is to establish the SPIDER VECTORS. [edit] [delete] [set planned values] [J 
Data SPIDER Survey Data SPIDER SURVEY Description, [edit] [delete] [set planned values] [] 


< back CIExport NCAT entities without referenced entities | Export | 


Create New “Services Survey” 


aril gel eee Ol 0 


= c Network Centric Operations Industry Consortium 


NCATE 


Wiser neak administrator.) Role: oysten, 


Name it “Services 
Survey” 


Fill Mandatory & 
Optional Fields 


Click on pull down 
for “Profile” and 
select “Services 
Profile” 


Click on pull down 
for “Program” and 
select “Services 
Program” 

Click on “Survey is 
active” 

Click on “Save” 
takes us back to 
“Surveys” page 


Home > Surveys > Edit survey 


Survey name*: Services Survey 


Description of Services Survey. 


Description (max. 
2000 characters): 


Start date 


08/04/2008 
(mm/dd/yyyy): f04f 
End date 
12/31/2008 
(mm/dd/yyyy): ff 
Leader: Bill Swanson 
Milestone: Complete Milestone 4 
Purpose: (Demonstrate NCAT 


Profile: Services Profile 


Services Program 


Program: 


Survey is active 


Created: 
Changed: 0) 


* - Fields are mandatory 


¢ Confirm creation of new “Services Survey” 
¢ Click on “Services Survey” Actions “set planned 


values” 


¢ Can only be set by “ncat_administrator” 


‘a | eel eee 0 


— 
FE en Ne FL Network Centric Operations Industry Consortium 


NCayt 
Home > Surveys 
Choose: 


Surveys [New survey] 
System Short List Vector Test Survey 


NCAT SPIDER Vector Survey 

System Vector Test Survey 
CONTENT2.11 SPIDER VECTOR SURVEY 
Data SPIDER Survey 


Services Survey 


=< back 


This survey is to establish the SPIDER VECTORS, [edit] [delete] [set planned values 
Data SPIDER SURVEY Description, [edit] [delete] [set planned values 


Description of Services Survey. [edit] [delete set planned values) 
_ —_ 


Liser ocat adrministrator.| Role. system, Adminstrator 


Description Actions Exp. 
System Short List Vector Test [edit] [delete] [set planned values 


[edit] [delete] [set planned values 


] 
] 
[edit] [delete] [set planned values] 
] 
] 


B/O/E)o)o;o 


CJ Export NCAT entities without referenced entities | Export | 


Setting “Planned Values” 


* Observe Services has six sub-categories which are labeled alphabetically. 

¢ Letter A is “Service Oriented Architecture” which has 2 questions. 

* Q1 of SOA is shown below. 

¢ Pick 2" choice “The System uses some services through ..... ” — The planned value 
¢ — Click “next question” 


ecasink damm iment a emma 


SS ——. Network Centric Operations Industry Consortium 


User. ncat administrator.|.Role.. system Administrator 


Note 1. Letter Designation of this category 
« back Category A: Service Oriented Architecture 


Note 2. 1 (2) indicates Q1 of 2 questions in this category 


Question Al (2): To what extent are system capabilities implemented as service 
te 2:components that are published and discoverable through open standards? 


Service Oriented Architecture (2). 
Open Architecture (7). 
Scalability (5). 
Availability (5). 


Note 1: 


YOU ARE EDITING PLANNED V4&LUES! 
© The functionality of the system is not implemented with service components. 


system uses some services through Web Services or Rest. 


Heterogeneity Accommodation (2). 
of the systems functions are implemented and deployed as services in a local 


nmono Ww > 


Enterprise Service Management (4)- 


ms functions are deployed and registered in a repository that is accessible 
embers of a COI who can use them. 


© System functionality is implemented by choreographing service invocations 
dynamically in a workflow that satisfies the mission goal, 


next question > end assessment 


‘& NCAT™ - Microsoft Internet Explorer 


File Edit View Favorites Tools Help 


G axk > Ey AB v7; _p~ Search =P Favorites & a6 Rae * lua P| 5 clip Book | el | 


Adaress #) http: flocalhost:8080/ncat/assessment.do 


+ Go Links 


— i | Network Centric Operations Industry Consortium 


NCATE 


< back 


Categories: 
Services 
Service Oriented Architecture 
Open Architecture 
Scalability 
Availability 
Heterogeneity Accommodation 


Enterprise Service Management 


Liser. fcatvadministrator.) Role. System Administrator 


Category A: Service Oriented Architecture 


Question A2 (2): To what extent are system capabilities implemented as service 
components that are accessed through a common Enterprise Service Bus (ESB)? 


YOU ARE EDITING PLANNED VALUES! 


No Enterprise Service Bus is used by the system. 


Proprietary middleware provides some of the basic services of an ESB. No specific 
procedures are in place to ensure uniform compliance. 


4n ESB is implemented internally that can provide basic services to the platform, 
Some standards are utilized in the implementation. 


4n ESB is implemented using widely used open standards that provide all the net- 
centric core services as well as critical event processing, security services and 
autonomic capabilities, Most of the system's functionality is implemented as services, 


4n open standard based COTS ESB that can mediate dynamic requests and match 
QoS requests with appropriate SLAs in non-real time, near real time and real time and 
interact with other ESBs deployed on the net-centric environment. The ESB is verified 
and certified to provide these capabilities, Uniform adoption is assured by 
comprehensive governance processes, 


< previous question next question > end assessment 


& NCAT™ - Microsoft Internet Explorer 


File Edit View Favorites Tools Help 


Geek - Sy |x) 2] OD) po search lp ravortes 3 Ct- See MM) Ek gaciptock FR] 8 


Adoress @) http: /#localhost:8080/ncat/assessment.do v EJ co Links ?? 


* 
on WS edt coe M0 
BB ==) 


tamed ™ 
—— Network Centric Operations Industry Consortium 


LANMCAT Liser.ncatvadministrator.| Role. System Administrator 


<= back Category B: Open Architecture 


1 (7) indicates Q1 of 7 questions in this category 


Categories: ; : . : 
Question B1 (7): Is the system architecture based on loosely-coupled interactions, 
Services enabling the internal components to map to well-defined external interfaces? 
Service Oriented Architecture 
S Open Architecture YOU ARE EDITING PL4NNED VALUES! 
Scalability The system is tightly integrated and not modular. 
Availability . . , 
: : ©) The system is constructed of well defined modules with well defined interfaces, but 
Heterogeneity Accommodation ~ the interfaces are proprietary or specific to the program. 
Enterprise Service Management @ The system is constructed of well defined modules with well defined interfaces. 


Interfaces are based on widely used open standards and consistent with the 
program or platform. 


The system is constructed of well defined modules with well defined interfaces. 
Interfaces are based on widely used open standards and consistent with the COT, 


The system is constructed using invoked dynamically discovered services or through 
choreography of services for both). Services implemented by this system are 
deployed and dynamically discoverable on the net-centric environment and accessed 
using net-centric core services for discovery, mediation, messaging, and connectivity, 


< previous question next question > end assessment 


File Edit ‘Yiew Favorites Tools Help 


© pak = x | ~| ¢ _p—) Search 5p Favorites 4 ‘. as > lol 


Accress 6} http: f/localhost:8080/ncat/assessment.do 


ry = Cj j tne Centric Operations Industry Consortivm 


~ANCAT™ 


< back 


Categories: 
Services 
Service Oriented Architecture 
Open Architecture 
Scalability 
Availability 
Heterogeneity Accommodation 


Enterprise Service Management 


User..ncat administrator.|,Role..syster, Administrator 


Category B: Open Architecture 


Question B2 (7): Is Web access implemented by the program built using Web 
Foundational standards: Hypertext Transfer Protocol (HTTP), Hypertext Mark up 
Language (HTML), File Transfer Protocol (FTP), User Datagram Protocol (UDP), 
Transport Control Protocol (TCP), Internet Protocol (IP), Simple Mail Transfer Protocol 
(SMTP), Multi-purpose Internet Mail Extensions (MIME), Uniform Resource Locator 
(URL), and Unicode universal character set? 


YOU ARE EDITING PLANNED VALUES! 


Web Access is not implemented by this system. 


@® This system utilizes some, but not all of the listed standards. 
This system implements and uses Web Access using most or all of the listed 


standards in their current form, The standards used have been verified to wark 
together. 


< previous question next question > end assessment 


@ NCAT™ - Microsoft Internet Explorer 


File Edit ‘Yiew Favorites Tools Help 


G sack ¥ . x] a] ’, _p~) Search 5) Favorites ioe 


Address @) http: /#localhost:8080/ncat/assessment.do ¥| Ea Go Links 


a) a os A ae 
ee ee Operations Industry Consortium 


NCAT User. ncatadministrator.|. Role. systern Administrator 
«< back Category B: Open Architecture 
Categories: ; . ; : 
Question B3 (7): Are Web services and web access implemented by the program built 
Services using Web Emerging Standards or Best Practices: HTTP State Management Mechanism, 
, . . MIME Encapsulation of Aggregate Documents such as HTML (MHTML), Web Distributed 
Service Oriented Architecture Authoring and Versioning (Web-DAY)? 
Open Architecture 
Scalability YOU ARE EDITING PLANNED VALUES! 
Availability 


: . © Web Access is not implemented in this system, 
Heterogeneity Accommodation 
Enterprise Service Management © This system utilizes distributed components but not web services. 


@® This system utilizes some, but not all of the listed standards. 


© This system implements and uses Web Services using most or all of the listed 
standards. 


This system utilizes Web Services standards and also utilizes Grid computing 
standards, 


< previous question next question > end assessment 


‘@ NCAT™ - Microsoft Internet Explorer 


File Edit View Favorites Tools Help 


G sak ’ 2 x] 2] v, , ' Search 5) > Favorites 4 > a) [dl 6S 24 cip Book 4 | rel ty 
—— ¥ E} co 


Address #) http: flocalhost:8080/ncat/assessment.do 


mat =| (om 


Va Network Centric Operations Industry Consortium 


hol 1 User. ncat administrator.) Role. Systern Administrator 
<= back Category B: Open Architecture 
Categories: ; ' : . 
Question B4 (7): Are Web services and web access implemented by the program built 
Services using XML Foundational Standards: XML Namespaces, Extensible Style Language 
, : : Transformations (XSLT), Extensible Style Language (XSL), XML Path Language 

Service Oriented Architecture (XPath), Cascading Style Sheets (CSS)? 

Open Architecture 

Scalability YOU ARE EDITING PLANNED VALUES! 

Availability 


< - © Neither Web Access nor Services is implemented in this system. 
Heterogeneity Accommodation 
Enterprise Service Management © This system utilizes distributed components but not web services, 


This system utilizes some, but not all of the listed standards. 


© This system implements and uses Web Services using mast or all of the listed 
standards. 


This system utilizes Web Services standards and also utilizes Grid computing 
standards. 


< previous question next question > end assessment 


PS 


* 


——- i 
a —— 7 x 


~~ , a= 


@& NCAT™ - Microsoft Internet Explorer (= \fe\hx| : 


File Edit View Favorites Tools Help i” we 


G sack ’ 2 ix] 2] , 7 ' Search 5 F Favorites €4 


Address @) http: /#localhost:8080/ncat/assessment.do v E} co Links. ?? 


NncoIc 


“ 
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polCAT 2 User. ncat administrator.|. Role. Systern Administrator 
«< back Category B: Open Architecture 
Categories: - - x . F 
Question B5 (7): Are Web services implemented by the program built using 
Services Representational State Transfer (REST), Simple Object Access Protocol (SOAP), Web 
. P : Services Description Language (WSDL), Universal Description, Discovery, and 

Service Oriented Architecture Integration (UDDI)? 

Open Architecture 

Scalability YOU ARE EDITING PLANNED VALUES! 

Availability 


: , Web Services are not implemented in this system. 
Heterogeneity Accommodation 
Enterprise Service Management © This system utilizes distributed components but not web services. 


@® This sy¥stem utilizes some, but not all of the listed standards. 


© This system implements and uses Web Services using most or all of the listed 
standards, 


This system utilizes Web Services standards and also utilizes Grid computing 
standards, 


< previous question next question > end assessment 


& NCAT™ - Microsoft Internet Explorer 


File Edit Yiew Favorites Tools Help 


© pak ’ . EI B v; 7’ ' Search Sie Favorites & 


Address |) http:/flocalhost:8080/ncat/assessment.do v E} co Links. ?? 


ee ee eee Operations Industry Consortivm 


pol CAT 2" User. neat administrator.|. Role. system Administrator 
<= back Category B: Open Architecture 
Categories: 


Question B6 (7): Are Web services products compliant with WS-Security Profile? 
Services 


Service Oriented Architecture 
YOU ARE EDITING PLANNED VALUES! 


Open Architecture 


Scalability © Web Services are not implemented in this system. 
Availability @© Web services that are used are implemented with proprietary interfaces. 
Heterogeneity Accommodation PA 


© Web services use products that are compliant, but configurations are not verified. 


Enterprise Service Management “, 
© Yes, fully compliant and verified. 


< previous question next question > end assessment 


= 


‘& NCAT™ - Microsoft Internet Explorer = (efx) 
7” 


File Edit Yiew Favorites Tools Help 


G sack ’ . EI AB ¢, 7 ' Search 5) > Favorites & 


¥ | Ea Go Links. 7 


mreoir 
ee ee Operations Industry Consortium 


pal CAT™ User. ncat administrator.) Role. System Administrator 
«< back Category B: Open Architecture 
Categories: - ; ; . ; 
Question B7 (7): Are Web services products compliant with the Web Services 

Services Interoperability (WS-I) Basic Profile? 

Service Oriented Architecture 

Open Architecture YOU 4RE EDITING PL4NNED VALUES! 

Scalability Fo 


Web Services are not implemented in this system. 


Availability ‘ 

2 z © Web services that are used are implemented with proprietary interfaces. 
Heterogeneity Accommodation 
Enterprise Service Management @® Web services use products that are compliant, but configurations are not verified. 


© Yes, fully compliant and verified. 


< previous question next question > end assessment 
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Eek)» 
Help e = 
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Address |) http:/flocalhost:8080/ncat/assessment.do wv E} co Links 7? 


~~ 


‘@ NCAT™ - Microsoft Internet Explorer 
File 


Edit ‘View Favorites Tools 


™ 
} \—— Network Centric Operations Industry Consortivm 


poltCAT User. cat administrator.|.Role. systerm Administrator 
I 


< back Category C: Scalability 


Categories: ; : . 
Question C1 (5): How many consumers of services deployed by this system are 
Services expected? 


C. Service Oriented Architecture 
Open Architecture YOU ARE EDITING PL4NNED V4&LUES! 
Scalability Web Services are not implemented in this system. 


Availability 


: : © Unknown/estimated. 
Heterogeneity Accommodation 


@® Empirical evidence shows that the system can support the expected number of 


Enterprise Service Management COnStimars: 


The system has been formally tested to meet the service level as defined in the 
specifications and is capable of scaling to meet excess demand, 


© The system includes automatic detection of increased usage and will autamatically 
increase capacity without human intervention, 


< previous question next question > end assessment 
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e 


& NCAT™ - Microsoft Internet Explorer 
File 


G pak ’ 3 x] A “¢ c ' Search 5 e Favorites &) ‘+ ae > lol co = Clip Book Be. | rel iB | 


» E} co Links 7? 


oe 
“~ 


Edit Yiew Favorites Tools Help 


Adaress #) http: flocalhost:8080/ncat/assessment.do 
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pelt CAT 2 Liser. ncat administrator... Role. system Administrator 
| 


< back Category C: Scalability 


Categories: - ty ; ' . 
Question C2 (5): How many service invocations of services deployed by this system 
Services per hour (or per some appropriate unit of time) are expected? 


Service Oriented Architecture 
Open Architecture YOU ARE EDITING PL4NNED VSLUES! 
scalability Web Services are not implemented in this system. 


Availability 


: " © Unknown/estimated. 
Heterogeneity Accommodation 


Empirical evidence shows that the system can support the expected number of 


Enterprise Service Management seinlige TrvOESTIOEE. 


The system has been formally tested to meet the service level as defined in the 
specifications and is capable of scaling to meet excess demand, 


©) The system includes automatic detection of increased service load and will 
~  gutomatically increase capacity without human intervention, 


< previous question next question > end assessment 


a 


we 


—e—~,  , ae 
& NCAT™ - Microsoft Internet Explorer Seles 
7” 


File Edit Yiew Favorites Tools Help 


© pack ’ . x] EI ¢ , ' Search 5 Favorites fe 


Address @) http: /#localhost:8080/ncat/assessment.do v E} co Links 7? 


memoir 
ee ee ec Operations Industry Consortivm 
palCAT 2 User neat administrator.|. Role. system Administrator 
< back Category C: Scalability 
Categories: 


Question C3 (5): On what assumptions or empirical tests are the above mentioned 
Services estimates based? 


Service Oriented Architecture 
Open Architecture YOU ARE EDITING PLANNED VALUES! 
Scalability Web Services are not implemented in this system. 


Availability 
© Unknown/estimated. 


Heterogeneity Accommodation 

Enterprise Service Management © Past usage history, 

© Surveys and agreements have been executed to provide best estimates. 
Hardware and software facilities are in place to scale automatically to meet usage 
and load requirements. 


< previous question next question > end assessment 


& NCAT - Microsoft Internet Explorer 


File Edit Yiew Favorites Tools Help 


G@ sack " we ix] 2 f Peels thal Sf Favorites €) ha Roe a lol 2% Cp Book ay | rel ba 


Address | dé) http:{flocalhost:8080/ncat/assessment.do ta" E} co Links >” 
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hlCAT 4 Liser. ncat administrator.|.Role.. oyster Administrator 
« back Category C: Scalability 
Categories: 


Question C4 (5): What performance analysis has been done to understand or predict 
Services the ability of the service to handle number of end-user consumers? 


Service Oriented Architecture 
Open Architecture YOU ARE EDITING PLANNED VALUES! 
Scalability 


Web Services are not implemented inthis system. 


Availability 


; : © Unknown/estimated. 
Heterogeneity Accommodation 


@® Empirical evidence shows that the system can support the expected number of 


Enterprise Service Management SAELIMGER: 


© The system has been formally tested to meet the service level as defined in the 
~ specifications and is capable of scaling to meet excess demand, 


© Hardware and software facilities are in place to scale automatically to meet usage 
and Joad requirements. 


< previous question next question > end assessment 


~ 


& NCAT* - Microsoft Internet Explorer [= fel 
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haftCAT Liser. ncat administrator.|.Role. oyster Administrator 


< back Category C: Scalability 


Categories: 
Question C5 (5): What performance analysis has been done to understand or predict 
Services the ability of the service to handle the expected number of calling services? 


Service Oriented Architecture 
Open Architecture YOU ARE EDITING PLANNED VALUES! 


Scalability Web Services are not implemented in this system. 
Availability 


; "1 © Unknown/estimated. 
Heterogeneity Accommodation 


F : @ Empirical evidence shows that the system can support the expected number of 
Enterprise Service Management ‘service demands: 


The system has been formally tested to meet the service level as defined in the 
specifications and is capable of scaling to meet excess demand, 


© Hardware and software facilities are in place to scale automatically to meet usage 
~ and load requirements. 


< previous question next question > end assessment 


‘@ NCAT™ - Microsoft Internet Explorer 


File Edit Yiew Favorites Tools Help 
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enters mus User. ncatadministrator.|.Role. oyster Administrator 
< back Category D: Availability 
Categories: 


Question D1 (5): Does the program have a continuity of operations plan? 
Services 


Service Oriented Architecture 
D. YOU ARE EDITING PLANNED VALUES! 
Open Architecture 


Scalability No plan is in place. 


Availability © Basic plan allows for MTBF and MTB recovery. No testing plan is in place. 


Heterogeneity Accommodation @ Basic plan allows for MTBF and MTB recovery, Testing plan is in place and exercised 


Enterprise Service Management regularly, 


© Acontinuity plan is in place to assure minimal MTBR including regular backups and 
testing. 


© Afault tolerant continuity of operations plan is in place and itis exercised on a regular 
basis with contingency operations also verified, 


< previous question next question > end assessment 
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< back Category D: Availability 


Categories: . ' oc. . : ’ ; 
Question D2 (5): Whatis the plan for providing service during routine maintenance 
Services (hardware and software)? 


Service Oriented Architecture 
Open Architecture YOU ARE EDITING PL4NNED VALUES! 


Scalability No plan is in place. 
Availability 


: : © Scheduled outages. 
Heterogeneity Accommodation 


Enterprise Service Management © Scheduled outages. Regular backups and test of backups is done. 


@ Backup systems are used to carry load while prime system is maintained, 
Synchronization is manual and requires man in the loop. 


© Backup systems are used to carry load while prime system is maintained, 
synchronization is automatic. 


< previous question next question > end assessment 
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< back Category D: Availability 


Categories: 
Question D3 (5): Whatis the plan for providing service during catastrophic failures 
Services (e.g. massive outages of the power grid, physical destruction of the hosting facility )? 


Service Oriented Architecture 


Open Architecture YOU ARE EDITING PL4NNED VALUES! 
Scalability No plan is in place. 
Availability : ! en 
©) Offsite backup and archives. Secondary site has been identified to reconfigure and 
Heterogeneity Accommodation ~ restart. MTBR > 1 day, 
Enterprise Service Management @ Offsite backup and archives. Secondary site has been identified to reconfigure and 


restart. MTBR less than 1 day, 
Distributed facilities are able to pick up load with some degradation of performance. 
© Completely redundant hardened site with automatic failover, No disruption of service, 


Failover is regularly tested and calibrated, 


< previous question next question > end assessment 
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«< back Category D: Availability 
Categories: 


Question D4 (5): Does the continuity of operations plan include procedures for finding, 
Services housing, and supporting the technical support staff during an emergency action? 


Service Oriented Architecture 
Open Architecture YOU SRE EDITING PLANNED VALUES! 


Beene No plan is in place, 

Availability 

7 - ©. Support plans include shelter in place. 
Heterogeneity Accommodation 


Enterprise Service Management ® Support plans include shelter in place or personal evacuation. 


© Evacuation plans are in place, but service would be disrupted during an emergency 
action, 


© ‘Yes, Emergency support or evacuation procedures are in place and tested on a 
regular basis. 


< previous question next question > end assessment 


& NCAT™ - Microsoft Internet Explorer 
File 


Edit View Favorites Tools Help 
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NCATE 


< back 


Categories: 
Services 
Service Oriented Architecture 
Open Architecture 
Scalability 
Availability 
Heterogeneity Accommodation 


Enterprise Service Management 


User ncat administrator.|.Role..Systerm Administrator 


Category D: Availability 


Question D5 (5): What percent of threat scenarios have been identified and validated 
for application to your design? 
YOU SRE EDITING PLSNNED V4SLUES! 
No threat scenarios have been considered in the planning. 
© Approximately 25 percent of threat scenarios have been considered in the planning. 
® Approximately 50 percent of threat scenarios have been considered in the planning. 
© Approximately 75 percent of threat scenarios have been considered in the planning. 


) Arobust set of threat scenarios has been considered in the planning. 


< previous question next question > end assessment 
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<= back Category E: Heterogeneity Accommodation 
Categories: 


Question E1 (2): How do you describe in which way the system will support bandvidth 
Services variability and universal utility on the battlefield independent of bandwidth constraints? 


Service Oriented Architecture 
Open Architecture YOU ARE EDITING PL4NNED VALUES! 
Scalability Only will support High Bandwidth wired LAN connection. 


Availability 


: : Multiple versions will be available for low to high bandwidth environments. 
Heterogeneity Accommodation 
; : @) The service has logic that will sense bandwidth availability but cannot adapt and will, 
Enterprise Service Management ~ thus only notify user of constraints and potential latency issues. 


The service will adapt to bandwidth conditions. 


The will service adapt to delivering end-to-end capabilities over a broad range of 
bandwidths (from low bit-rate tactical communications to multi-gigabit backbone 
service), environments (fixed and wireless}, and end-user devices (e.g., PDAs, 
laptops, workstations, mainframes). 


< previous question next question > end assessment 
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haltCAT Liser..mcat administrator.|. Role. system Administrator 
« back Category E: Heterogeneity Accommodation 
Categories: 


Question E2 (2): Does the system support delivery of capabilities to thin or browser- 
Services based clients, especially those that provide adaptability to a variety of disadvantaged 


2 2 5 edge environments for end-users? 
Service Oriented Architecture 


Open Architecture 


ail YOU ARE EDITING PLANNED VALUES! 
Scalability 


Availability © The program can only support Client server environments. 
Heterogeneity Accommodation »y The program requires high bandwidth to support thin or browser-based clients via 


; - servlets or portlets. 
Enterprise Service Management ‘ P 


© The program may support low bandwidth to thin or browser-based clients via servlets 
or portlets. 


@) The program does support low bandwidth to thin or browser-based clients via 
servlets or portlets. 


The program will support delivery of capabilities to thin or browser-based clients, 
especially those that provide adaptability to a variety of disadvantaged edge 
environments for end-users, 


< previous question next question > end assessment 
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<= back Category F: Enterprise Service Management 

Categories: ; F ox . ; 
Question F1 (4): Does the service provide instrumentation to enable the service 

Services provider to determine the current operational state and performance level of the 
service? 


Service Oriented Architecture 


Open Architecture 
Scalability YOU ARE EDITING PLANNED VALUES! 
Availability © The service does not provide instrumentation to enable the service provider ta 
, etermine the current operational state and performance level of the service. 
det th i t | stat d pert level of th 


Heterogeneity Accommodation ‘ pan ng R ‘ : P 
5 ¥ ©) The service does provide instrumentation to partially enable the service provider to 


Enterprise Service Management ~ determine the current operational state and performance level of the service. 


@ Scalability, configuration, diagnosing, healing and error logging and recovery require 
_ an operator, and operator is assisted by a comprehensive set of instrumentation and 
tools. Logging of errors is automatic. 


© Comprehensive system support and network monitoring provides operator with 
~ online configuration and error diagnosing and recovery. Logging is uniform across the 
domain. 


© Automatic and dynamic scalability, self-configuration, self-healing, self-diagnasing, 
~ and uniform error logging and recovery are enabled across the net-centric 
environment, 


< previous question next question > end assessment 
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{| 


< back Category F: Enterprise Service Management 


Categories: - . - 
Question F2 (4): How do you describe the nature of the service management 
Services information made available to consumers and providers of the net-centric environment 


rs , , such the Global Information Grid? 
Service Oriented Architecture 


Open Architecture 
ai YOU SRE EDITING PLANNED VALUES! 
Scalability 
Availability ©) No service management information function will be made available to consumers or 
~ provider of the service. 


Heterogeneity Accommodation ; 4 : pe 
a ¥ Service level agreements are included in the description of the service, but are not 


Enterprise Service Management ~ available for runtime use. 


@ Limited service management information, not including performance metrics and 
problem/outage status information, will be made available to consumers or providers 
of the service, 


Service Management information, including performance metrics and problem/outage 
status information, will be made available to consumers and providers of the service, 


©) SL&s are part of the service descriptor and are based on open standards. The QoS is 

~ dynamically available and can be used to match requestors' required SLAs with a 
provider's QoS, These services are dynamically discoverable and accessed using net- 
centric core services for discovery, mediation, messaging, and connectivity, 


< previous question next question > end assessment 
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heMCAT a4 Liser. ncat administrator.|, Role: oyster. Administrator 
<= back Category F: Enterprise Service Management 
Categories: 


Question F3 (4): To what extent are protocols and standards being used to collect and 
Services disseminate service management information? 


Service Oriented Architecture 


Open Architecture YOU ARE EDITING PL4NNED VALUES! 
Stalability No service Management function is provided. 
Availability sae : ra ‘ : ‘ 
. . ©) Limited QoS information is available at runtime. It is available only through proprietary 
Heterogeneity Accommodation ~ interfaces and APIs. SLA is described with program specific formats, 
Enterprise Service Management @) SLAs are defend with open standard formats and are dynamically discoverable. 
~ Mechanisms are available to provide runtime QoS of deployed services using open 
standards. 


If service Management function is provided, standards used to collect and 
disseminate service management information, and in what format will it be made 
available (e.g., SNMP, XML, CIM), 


SL4s are part of the service descriptor and are based on open standards. The QoS is 
dynamically available and can be used to match requestors’ required SLAs with a 
provider's QoS, These services are dynamically discoverable and accessed using net- 
centric core services for discovery, mediation, messaging, and connectivity, 


< previous question next question > end assessment 
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<= back Category F: Enterprise Service Management 


Categories: . : ; - 
Question F4 (4): Has this program provided completed examples of all Service Level 
Services Agreements negotiated by this provider with others? 


Service Oriented Architecture 


Open Architecture YOU 4RE EDITING PLANNED VSLUES! 

Scalability © No Service Level Agreements (SLA) has been or will be negotiated by this service 
Availability provider with others. 

Heterogeneity Accommodation © Some SLAs have been negotiated and provided for other service providers. 
Enterprise Service Management @ SLAs have been negotiated and provided with other service providers with which it 


will interoperate. 


4 complete list of completed examples of all Service Level Agreements (SLA) 
negotiated by this service provider with all other service providers and consumers 
with which it will interoperate has been provided. 


SLAs have been negotiated with all other providers and consumers and are 
automatically enforced by the infrastructure - the ESB. 


< previous questio end assessment 


End Assessment Returns you to the 


¢ Click “Back” takes you to “Home” 
¢ Note the Assessment is not complete, just the setting 
of the Planned Values 
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Summary 


You have completed the assessment successfully, 
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| Done 


Back to “Home” 


Network Centric Operations Industry Consortium 


NCAT OY ——__ Wer catwadministrator.|, Role: system Administrator. 


¢ Click on 
“Assessments” 


¢ Observe if any 
assessments 
are visible for 
“Services” 


NCAT™ overview 


Create, edit and delete users 


Users 


Programs Create, edit, delete 4 program 


Categories, Questions and 
Answers 


Create, edit, delete a category; create, edit, delete questions and answers 


Profiles Create, edit, delete profiles which are based on copies of categories containing questions and answers, 


The content definer may tailor categories, questions and answers of a profile, 
Create, edit, delete a surveys by assigning a profile to a program 


View and delete assessments 


References Create, edit and delete references 


Guidances Create, edit and delete guidances 


Sih a Assessment for System Short List Vector Test Survey System Short List Vector Test 
NCAT SPIDER Vector Survey - 
System Vector Test Survey - 
CONTENT2.11 SPIDER VECTOR SURVEY This survey is to establish the SPIDER VECTORS, 
Data SPIDER Survey Data SPIDER SURVEY Description, 
Services Survey 


Description of Services Survey, 


Generate Report from Report = jwoAT Report Assessment 
Template 
NCAT Report Survey 


Excel NCAT Report Basic V2.0 


Report Templates Upload, delete report templates 


Import Data Import NCAT entities from data file 
Export Data Export all NCAT entities to data file 


No Assessments visible for Services 


« “Services Assessment’ has not been created at this time 
¢ Click on “Home” 


eh. acat administrator, Roleystem Administrator 


Choose: 

Assessments User Survey Actions Exp. 
System Vector Test Survey - ncat_administrator neat_administrator System Short List Vector Test Survey [delete] | [] 
NCAT SPIDER Vector Survey - ncat_administrator neat_administrator NCAT SPIDER Vector Survey [delete] | [J 
NCAT SPIDER Vector Survey - Content Definer NCAT SPIDER Vector Survey [delete] [] 
System Short List Vector Test Survey - Content Definer System Short List Vector Test Survey [delete] [J 
‘CONTENT2.11 SPIDER VECTOR SURVEY -ncat_administrator ncat_administrator CONTENT2.11 SPIDER VECTOR SURVEY [delete] [7] 
Data SPIDER Survey - ncat_administrator neat_administrator |Data SPIDER Survey [delete] | [J 


¢ Click on 
“References” 


¢ Observe if any 
references 
are visible 


; Network Centric Operations Industry Consortium 
NCATE. = Lisehwhicatwadininistrator.)RalenSystemAdnimistratats. 


NCAT™ overview 


Create, edit and delete users 


Users 


Programs Create, edit, delete 4 program 


Categories, Questions and 
Answers 


Create, edit, delete a category; create, edit, delete questions and answers 


Profiles Create, edit, delete profiles which are based on copies of categories containing questions and answers, 


The content definer may tailor categories, questions and answers of a profile, 


Surveys Create, edit, delete a surveys by assigning a profile to a program 
Assessments View and delete assessments 
Create, edit and delete references 


uidances Create, edit and delete guidances 


Sih a Assessment for System Short List Vector Test Survey System Short List Vector Test 
ze NCAT SPIDER Vector Survey _ 


System Vector Test Survey - 
CONTENT2.11 SPIDER VECTOR SURVEY This survey is to establish the SPIDER VECTORS, 


Data SPIDER Survey Data SPIDER SURVEY Description, 
Services Survey 


Description of Services Survey, 


Generate Report from Report = woaT Report Assessment 
Template 
NCAT Report Survey 


Excel NCAT Report Basic V2.0 


Report Templates Upload, delete report templates 


Import Data Import NCAT entities from data file 
Export Data Export all NCAT entities to data file 


Setup “References” 


¢ Click on “References”. Currently empty. 


¢ If “Services Reference” is not present, click on “New Reference” to 
create it 


AN 7 - Microsoit fernet Explor led 


File Edit View Favorites Tools Help 


G pak . ; x | ~| 7 _p—' Search =p Favorites gS i poe ie) Ld as lod 25 clip Book Fe. | ‘sl id 
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NCATE Liser. ncat administrator.|.Role. oyster Administrator 


Home > References 


Choose: 


Reference Text [New Reference] Link Actions Exp. 


< back 


_]Export NCAT entities without referenced entities [ Export | 
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9 Local intranet 


Create new “Services Reference” 


« Name new item “Services Reference” 
¢ Add a link to “google” and click “Save” 


r= = a co 
a "Network Centric Operations Industry Consortium 


DO, Geet | 


User.acatadministratorn.)Role..Systen. Administrator 


C NCAT 7 ww! 


Home > References > Edit reference 
Text*: ‘Services Reference 
Link: ‘http://www .google.com/ 
Created: 0) 
Changed: {) 


* - Fields are mandatory 


C | | Gxel Do ancel | 


© Copyright 2007,2008 NCOIC - All Rights Reserved 
© 9 Local intranet 


[Logout] 2 


| 


2) Done 


Confirm new “Services Reference” 


¢ Observe new “Services Reference’ is created with 
the link to Google 


¢ Click “back” or “Home” to return “Home” 


a Ted oe Co 
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User..acatwacdministrator.)Role.. systen.Adnminmstratar 


Choose: 
Reference Text [New Reference] Link Actions Exp. 
Services Reference http: //www.google.com/ [edit] [delete] [] 


KC ebak 2 ClExport NCAT entities without referenced entities |_Export | 


e ( | | ck O Nn ' Network Centric Operations Industry Consortium 


‘6 . Th eC ATT —EEEEe Lisehwteah acter a nistrator..|.Rales =H System Administrator, 
Guidances 


¢ Observe if any 
“Guidances” 
are visible 


NCAT™ overview 


Create, edit and delete users 


Users 


Programs Create, edit, delete 4 program 


Categories, Questions and 
Answers 


Create, edit, delete a category; create, edit, delete questions and answers 


Profiles Create, edit, delete profiles which are based on copies of categories containing questions and answers, 


The content definer may tailor categories, questions and answers of a profile, 


Surveys Create, edit, delete a surveys by assigning a profile to a program 


Assessments View and delete assessments 


Create, edit and delete references 


Create, edit and delete guidances 


Seika Assessment for System Short List Vector Test Survey System Short List Vector Test 
NCAT SPIDER Vector Survey - 
System Vector Test Survey - 
CONTENT2.11 SPIDER VECTOR SURVEY This survey is to establish the SPIDER VECTORS, 
Data SPIDER Survey Data SPIDER SURVEY Description, 
Services Survey 


Description of Services Survey, 


Generate Report from Report = jwoaT Report Assessment 
Template 
NCAT Report Survey 


Excel NCAT Report Basic V2.0 


Report Templates Upload, delete report templates 


Import Data Import NCAT entities from data file 
Export Data Export all NCAT entities to data file 


Setup new “Guidance” 


¢ If “Services Guidance’ is not present, click on “[New Guidance] to 
create it. 
ET 7 - Microsoit ferne m dbilery led 
File Edit Yiew Favorites Tools Help ~ | 
G pak Ss . *| ~| 7 7 Search 5 e Favorites & 


Address 


5S |) http: flocalhost:8080/ncat/main.do?action=quidanceIndex 


r — | j Ctetiogt Centric Operations Industry Consortium 


NCAT User. ncatadministrator.|. Role. systen Administrator | 
Home > Guidances 

Choose: 

Guidances [New guidance] Text Actions Exp. 

< back ClExport NCAT entities without referenced entities | Export ] 
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* } Local intranet 


Setup “Guidances” 


¢ Create “Services Guidance’, add Text 


¢ Use the “Reference” pull down to select available “Services 
Reference” 


¢ Click “Save’ to return to “Guidances”. Confirm “Services Guidance’. 


’ i 
be Network Centric Operations Industry Consortium 


LUiser. acatwacdministrator.|. Role... SystenAdnminstratar 


Home > Guidances > Edit guidance 


Name*: Services Guidance 


Explains selection criteria for specific Questions and Answers. 


Text (max. 2000 


characters): 
Reference: -- no reference -- vj 
Created: -- no reference -- 
-- new reference -- 
Changed: Services Reference 


* - Fields are mandatory 


Confirm “Services Guidance” 


¢ Confirm new Guidance successfully created. 
¢ Click “back” or “Home” to return to “Home” screen. 


od on 


—— Network Centric Operations industry Consortium 


wNGALE 


User.ncat administrator. |, Role: Ssvstenn Administrator. 
Home > Guidances 


Choose: 
Guidances [New guidance] 


Text 
Services Guidance 


Actions Exp. 
Explains selection criteria for specific Questions and Answers, 


[edit] [delete] (] 
< back 


LJ Export NCAT entities without referenced entities | Export | 


‘© Copyright 2007,2008 NCOIC - All Rights Reserved 


[Logout] ., 


Back to “Home”, Go to “Profiles” 


Click on 
“Profiles” 


_— 
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NCATE. = Lisehwhicatwadininistrator)RalenSystemAdroimistratats. 


NCAT™ overview 


Create, edit and delete users 


Users 


Programs Create, edit, delete 4 program 


Categories, Questions and 


ars Create, edit, delete a category; create, edit, delete questions and answers 


Create, edit, delete profiles which are based on copies of categories containing questions and answers, 
The content definer may tailor categories, questions and answers of a profile, 


Create, edit, delete a surveys by assigning a profile to a program 


Assessments View and delete assessments 


References Create, edit and delete references 


Guidances Create, edit and delete guidances 


ih Assessment for System Short List Vector Test Survey System Short List Vector Test 
NCAT SPIDER Vector Survey - 
System Vector Test Survey - 
CONTENT2.11 SPIDER VECTOR SURVEY This survey is to establish the SPIDER VECTORS, 
Data SPIDER Survey Data SPIDER SURVEY Description, 
Services Survey 


Description of Services Survey, 


Generate Report from Report = jwoaT Report Assessment 
Template 
NCAT Report Survey 


Excel NCAT Report Basic V2.0 


Report Templates Upload, delete report templates 


Import Data Import NCAT entities from data file 
Export Data Export all NCAT entities to data file 


Go back to “Services Profile” to link Ré 


¢ Click on “Services Profile” Actions “modify assigned C/Q/A” 
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NCAT User. ncat administrator.) Role. SysteneAdnmaumis trator 


Home > Profiles 


Choose; 

Profiles [New profile] Actions Exp. 

CONTENT2.11 SPIDER VECTOR PROFILE [edit] [delete] [modify assigned C/o/A]  [] 

Data SPIDER Profile [edit] [delete] [modify assigned C/o/A] ) [J 
edit 


NCAT SPIDER Vector Profile [edit] [delete] [modify assigned C/o/A] [] 


Services Profile 


System Vector Test Profile [edit] [delete] [modify assigned C/o/4]  [] 


mmc 
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User ncatwadministrator.)Role..System Administrater 


Services 


<back [edit category] [delete category) (up) [down] [export] [exp. without ref, entities] 
Services 


Questions [Add question] Move question Actions Exp. 


[Add sub category to selected category ] No question found, Use "Add question" to add one in this category level, 


Categories: 

Services 
Service Oriented Orchitecture 
Open Architecture 
Scalability 
Availability 
Heterogeneity Accommodation 
Enterprise Service Management 


NEW Cer lcs Com@LUC=t-1i(olamarct-rellalemacticia-yaler- 


¢ Both questions in “Service Oriented Architecture’ are visible 
¢ Click on Actions “Edit” for top Question 


rm coe mie 
FC Set FS Network Centric Operations Industry Consortium 


ANCATT User mcat.administratore) Role. systen.Administratar 
Service Oriented Architecture 
< back [edit category] [delete category) [up] [down] (export) (exp. without ref. entities] 
Services 
; ; Move . 
Questions [Add question] ; Actions Exp. 
[Add sub category to selected category ] ———— question 
To what extent are system capabilities implemented as 
. service components that are published and discoverable [down] [edit] [delete] [] 
Categories: through open standards? 
Services To what extent are system capabilities implemented as 
service components that are accessed through acommon — [up] [edit] [delete] [] 
Service Oriented Architecture Enterprise Service Bus (ESB)? 
Open Architecture ss 
Scalability _JExport NCAT entities without referenced entities | Export 


Availability 
Heterogeneity Accommodation 
Enterprise Service Management 


Observe 
question 
structure 
— Text 


— Description 


¢ Must fill with 
something 


— Weight 
— Reference 


¢ Pull down to 
select 
“Services 
Reference” 


— Answers 
— Active box 
— Click “Save” 


a 
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Questions of selected category "Service Oriented Architecture " 


Home > Categories > Questions of selected category > Edit question 


Question text* 
(max. 1000 
characters): 


Description (max. 
2000 characters): 


Weight*: 


Reference: 


Answers: 
[Add answer] 


Question is active 
Created: 
Changed: 


To what extent are system capabilities implemented as service components that are 


published and discoverable through open standards? 


1 


Services Reference 


Reference link: htto://www.google.com/ 


The functionality of the system is not implemented with service components. 


The system uses sa 


Many of the systems functions are implemented and deployed as services in a local 


repository. 


The systems functions are deployed and registered in a repository that is accessible 


Answers: 


me services through Web Services or Rest, 


for all members of a COI who can use them, 


System functionality is implemented by choreographing service invocations 


dynamically in a workflow that satisfies the mission goal. 


| 


re 


Scale Move 
Value Answer 


0 [down] eit 


aq «=, Lue] [edit] 
: [down] [delete] 
eo tue) [edit] 
[down] [delete] 
go luo) [edit] 
[down] [delete] 


100, | [ue] deo) 


Actions Exp. 


[ 


OJ Export NCAT entities without referenced entities | Export 


TOXML script version 2008-02-20 (2008-07-08 16:19:23.0) 
neat_administrator (2008-07-15 00:57:47,394) 


* - Fields are mandatary 


| Save || Cancel | 


Oey al iigeimacsr-1e]leomeym-lelellalem atcyicla- ale 


¢ Taken back to Higher Level 
¢ Observe new Green Ref tag 
¢ Click on Edit again 


af), = Network Centric Operations Industry Consortium 


NATIT Liserincatwadministratores) Role: system Administrator 


Service Oriented Architecture 


< back [edit category) [delete category) [up] [down] [export] [exp. without ref. entities] 
Services 
Questions [Add question] ‘gpoict Actions Exp 
question 5 


egory tos gory 
[Add sub category to-selected category | To what extent are system capabilities implemented as 


service components thater siched and discoverable [Gown] [edit] [deleke]) [] 
Categories: ards?_[Ref.]__ 


To what extent are syste les implemented as 
; service components that are apéoghed through acommon [up] [edit] [delete]) [] 
Service Oriented Architecture Enterprise Service Bus (ESB)? 


Services 


Open Architecture 
Scalability | Export NCAT entities without referenced entities [ Export | 
Availability 

Heterogeneity Accommodation 


Enterprise Service Management 


PNolome1el(erclalersmcem-AValyii-) a 


Guidance is 
not visible 
until an 
answer Is 
selected 
using “edit” 
Guidance 
aids 
Assessor in 
selecting a 
particular 
response 


Questions of selected category "Service Oriented Architecture " 


Home > Categories > Questions of selected category > Edit question 


Question text* 
(max. 1000 
characters): 


Description (max. 
2000 characters): 


Weight*: 


Reference: 


Answers: 
[Add answer] 


Question is active 


Created: 
Changed: 


To what extent are system capabilities implemented as service components that are 
published and discoverable through open standards? 


1 


| Services Reference : v| 
Reference link: http://www .google.com/ 


Scale Move 


Answers: MA hrceecr Actions Exp. 
The functionality of the system is not implemented with service components. 0 [down] ced oO 
The system uses some services through Web Services or Rest. 30 on fedit] oO 
Many of the systems functions are implemented and deployed as services in a local a0 [up 
repository. [dow 
The systems functions are deployed and registered in a repository that is accessible 80 [up] {edit] oO 
for all members of a COI who can use them. [down] [delete] 
System functionality is implemented by choreographing service invocations 100 | [up] [edit] oO 
dynamically in a workflow that satisfies the mission goal. we (delete) 


CJ Export NCAT entities without referenced entities 


ToXML script version 2008-02-20 (2008-07-08 16:19:23.0) 
neat_administrator (2008-07-15 00:59:23,355) 


* - Fields are mandatory 


(Save) (Caneel) 


aliiialemiamAVarlui(s) mClUller-laler-mam acciicla-)aler- 


¢ Observe Answers can have both Guidance and Reference 
¢ Use pull downs for each to select and resave 


Home > Categories > Questions of selected category > 
co 


"To what extent are system capabilities implemented as service 
mponents that are published and discoverable through open standards? " > Edit answer 


Many of the systems functions are implemented and deployed as services in a local repository. 


Answer text* 
(max. 1000 
characters): 


Explanation* 
(max. 2000 
characters): 


Scale value*: 60 | 


<| 


[-- no guidance -- 


Guidance: 


Reference: -- no reference -- 


Answer is active 


Created: ToXML script version 2008-02-20 (2008-07-08 16:19:23.0) 
Changed: () 


* _ Fields are mandatory 


(coast) 


z == 
SS Fa si 


Use pull downs for each to select and resave 


Home > Categories > Questions of selected category > "To what extent are system capabilities implemented 
as 


service components that are published and discoverable through open standards? " > Edit answer 


Many of the systems functions are implemented and deployed as services in a local repository, 
Answer text* 
(max. 1000 
characters): 


Explanation* 
(max. 2000 
characters): 


Services Guidance ¥| 


Guidance text: Explains selection criteria for specific Questions and 
Services Reference _ _ 
Reference link: http://www .google.com/ 


v 


Answer is active 


Created: 


TOXML script version 2008-02-20 (2008-07-08 16:19:23.0) 
Changed: 


neat_administrator (2008-07-15 01:09:22,215) 


* - Fields are mandatory 


C{save ] (CancaD) 


Confirm Results 


. O bse rve Questions of selected category "Service Oriented Architecture " 
Home > Categories > Questions of selected category > Edit question 
References for 
. tion text* Lieve pal aa ete ah rola Implemented = service components that are 
the Question Question text [published and discoverable through open standards? 
characters ): 
and the [Ref] | al 
and [Guid] for a 
Description (max. 
2000 


an answe r. characters): 


¢ Click “Save” 
and return to 
“Profile” list. —; 
{edit] 


: T5 +b) : ‘ ; z : , 
The funct lity of th ti it | ted with ts. 0 d —— 
e Cl ick Home e functionality of the system is not implemented with service components [down] [delete] O 


[up] [edit] 
30 [down] (delete) U 
are implemented and deployed as services in a 60 (up) [edit] oO 
[down] [delete] 


Weight*: 


| Services Reference 
Reference link: http://www .google.com/ 


Reference: 


Scale Move 


Answers: Value Answer 


The system uses some services through Web Services or Rest. 


to sta rt Answers: Many of the 


[Add answer] local rep@sitory. [Ref.] [euid 


“A ed The syste i gemioyed and registered in a repository that is 80 (up) {edit] oO 
SSeSSI Y 1e Nn accessible for all reper of 3 COI who can use them. [down] [delete] 
System functionality is implemented by choreographing service invocations 100 [up] eats oO 


dynamically in a workflow that satisfies the mission goal. 


CJ Export NCAT entities without referenced entities 


Question is active 


Created: ToOXML script version 2008-02-20 (2008-07-08 16:19:23.0) 
Changed: neat_administrator (2008-07-15 00:59:23,355) 


* _ Fields are mandatory 


Log out as Admin, Log in as “Services% 


¢ Clickon Logout a heats 
to logout as the NCAT™ overview 
Nn cat_ Users Create, edit and delete users 
Categories, Questions and 


. ' Programs Create, edit, delete a program 
administrator 
Answers 


e Pp re a re to lo Profiles Create, edit, delete profiles which are based on copies of categories containing questions and 
answers, The content definer may tailor categories, questions and answers of a profile, 
Surveys Create, edit, delete a surveys by assigning a profile to a program 


back | Nn as th e Assessments View and delete assessments 
Ass eCSSO r ée J O h Nn References Create, edit and delete references 


Guidances Create, edit and delete guidances 


. 55 . 
Q S e rvi ces W | t h Perform Assessment for System Short List Vector Test Survey System Short List Vector Test 


Survey: 
NCAT SPIDER Vector Survey - 
a U Se mM a mM e System Vector Test Survey . 
CONTENT2.11 SPIDER VECTOR SURVEY This survey is to establish the SPIDER VECTORS. 
Data SPIDER SURVEY Description, 


iT) . 3 Data SPIDER Survey 
S e rv | ces a Nn d Services ae Description of Services Survey. 
6 +P] 
pa SSWO rd Nn cat leith Reportfrom Report cat Report Assessment 


NCAT Report Survey 
Excel NCAT Report Basic V2.0 


Create, edit, delete a category; create, edit, delete questions and answers 


Report Templates Upload, delete report templates 
Import Data Import NCAT entities from data file 
Export Data Export all NCAT entities to data file 


© Copyright 2007,2008 NCOIC - All Rights Reserved [Legout) 


OFA ME Uh Ke) ar-liat-er-le) 


pf The user will download the Java Zip files and install the 
NCAT program 


The user will log in as the “ncat_administrator” & do the 
following: 


SY — setup a new User Account for “John Q Services” (username 
“Services’, 


SY — create a new Program called “Services Program”, 
— create anew Profile called “Services Profile’, 

SY — create anew Survey called “Services Survey’, 
— set Planned Values, log out 

fepo: |he user will: 

= _ log in a second time as “Services”, 
— perform the assessment answering 25 questions 
— Runsome reports and examine them 


¢ Login as “Services” (password = ncat) 
¢ Perform Assessment for “Services Survey” 
¢ Confirm User: “Services” in a Role of “Assessor” 


¢ Note significantly cleaner “Home” screen showing only what this 
user is setup to accomplish 


¢ Click on “Perform Assessment’ for “Services Survey” 


McCool 


’ nd ™ 
‘—— Network Centric Operations Industry Consortium 


NCATE 


LisenSetviceSeluRoleASSeSsor » 
ee 


NCAT™ overview 


Perform Assessment for 


Survey: Services Survey Description of Services Survey 


Generate Report from Report NCAT Report Assessment 
Template 
NCAT Report Survey 


© Copyright 2007,2008 NCOIC - All Rights Reserved [Logout] 


Start Assessment 


¢ Click on “Start Assessment” 


@ NCAT™ - Microsoft Internet Explorer 


File Edit Yiew Favorites Tools Help 


; 7 She raver 
G sek : || BY Search Favorites i 


Address #) http: flocalhost:8080/ncat/assessment.do ¥| >| Go Links 
BC: Gee | 


—— Network Centric Operations Industry Consortivm 


Liser:. Services..|.Role>Assessor 
Home > Assessment 


Assessment for Survey: "Services Survey" 


Survey description: " Description of Services Survey, " 


Start assessment > 


© Local intranet 


Observe 1° question 


cal oan A A alin 
rico 


———~ Network Centric Operations Industry Consortium 


NCAT™ User. Services| Role, Assessor 


= back Category A: Service Oriented Architecture 


Categories: 
Question Al (2): To what extent are system capabilities implemented as service components that are 
Services published and discoverable through open standards? 


Service Oriented Architecture - 


Open Architecture reference ,,, 


Scalability © The functionality of the system is not implemented with service components. 


Availability ‘ - 

The system uses some services through Web Services or Rest. 

Heterogeneity Accommodation ; Poe, ; 
Many of the systems functions are implemented and deployed as services in a local repository, 


Enterprise Service Management quidance ... faterenée..., 


© The systems functions are deployed and registered in a repository that is accessible for all members af 
e Observe ~ a COI who can use them. 


System functionality is implemented by choreographing service invocations dynamically in a workflow 


— reference and guidance © that satisfies the mission goal. 
boxes show up Your comments / notes: 

— acomments /notes box is 
visible 


e Answer question 
¢ Click on next question 


e Repeat until all 25 questions next question > end assessment 
are answered 


Assessment Ends & returns to “Home 


End of Assessment returns Assessor to NCAT Overview 
¢ End of Assessment by User: “Services” 


It is possible to have multiple Assessors (not covered in this 
tutorial) 


¢ Click on “NCAT Report Assessment” 


An T™ - Micre 


File Edit View Favorites Tools Help 


G rex ’ . | | | 7 / Search ip Favorites &4 ‘+ ae > Ll 25) clip Book ie] 


doress |} http:/#localhost:8080/ncat/main.do 


rm = Cc j Ce tetwet Centric Operations Industry Consortium 


NCATE Usehin Services leROlewASSESSObes 
NCAT™ overview 


Perform Assessment for 


Survey: Services Survey Description of Services Survey 
Generate Report from Repold NCAT Report Assessment 
Template 


NCAT Reporte'sarrey 
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% 4 Locsl kivanet 


Java Tutorial Recap 


W The user will download the Java Zip files and install the 
NCAT program 


¢ The user will log in as the “ncat_administrator” & do the 
following: 


— setup a new User Account for “John Q Services” (username 
“Services”, 


create a new Program called “Services Program’, 
create a new Profile called “Services Profile’, 
create anew Survey called “Services Survey’, 
set Planned Values, log out 


,, Ehe user will: 

— log in a second time as “Services”, 

— perform the assessment answering 25 questions 
— Runsome reports and examine them 


QPL LAK 


t 


© 


\ 


Od pToles-{-m a=) elelamm BY, el- 


¢ Choose “Services Survey” Assessment performed by username “Services” 
¢ Observe there are three Export Types: PDF, HTML, Word 
¢ Choose Export Type, for this exercise click on “(Word)” 


y : = 
s NC f MiCrosolrt internet txplor x 
a | 
| 


File Edit View Favorites Tools Help 


G sxx , . all =| 7 a Search =i > Favorites Ge ‘+ ba > jw) * (ued 25) clip Book fag | ‘st 3 


ss |) http: /localhost:8080/ncat/main.do?action=report&name=NCAT_Report_Assessment&type=assessment Go 3 “6: 


ry = Cc [ Ce" Network Centric Operations Industry Consortium 


NCAT I Liser. SetvicesalRolenaASSeSsor 


Please select an assessment you have answered: 


Assessments 


Export Type 
Services Survey - ncat_administrator (PDF) (HTML) (Word) 
Services Survey - Services (PDF) (HTM 5 (ward) ) 
< back 


© Copyright 2007,2008 NCOIC - All Rights Reserved 


=) Done 


[Logout] 
4 Local intranet 


Services Survey Assessment Report 


ry = a [ ag Network Centric Operctions Industry Consortiem 


Assessment 


Assessment Report showing all Information for the specified Assessment 


Assessment information 
fibte: The information below is specific to the program beeing assessed. 
Program Information 
evel oiics Services Program 
Program Purpose: 


Lead Organization: (e.g. Army, Dia, 


indusiry) NCAT Functional Team 


Program Manager's Information 
Name: 
Email Adress: 
Telephone Number; 


Office Code/Symbol: 


NCAT Assessment Information 
eee ueeteees) 7/15/2008 


Lead Assessor's Information 


eles Services 
Brimecoos Join O Services@Raytheon.com 
itm item (972) 123-4567 


CRE OMelin ASSESSOr 


General Role: 


sa latellatem-lareme@s-jialeMiat-m mlelclare 


B Root Category First Category Element 


B_1 Sub Category Subordinated Category Element 


Question Question element 


Answer Answer from survey 


Selected Answer Answer selected by Assessor 


Planned Answer Expected Answer 


Selected Answer corresponds to 
Planned and Selected Answer expected Answer 


¢ The Legend is on the very last page of the report. 

¢ Legend explains the color code for reading the assessment results 
— Black means “not selected” 
— Red means “Planned or Expected Value” set by ncat_administrator 
— Blue means “achieved value” selected by the user “Services” 


— Green means the “achieved value” set by the Assessor matches the 
“Planned or Expected Value” set by the ncat_administrator 


2s SxWce COM cS fiat ave 


reed ponan 
> 


Planned 


Maryottte systems Tactoas are mpkme wedarddepkyed as serubes habeal repos tory. 
osltory tha’ Achieved 

ankaity ha 
Comment 


102 SYS 


SAS me Sev 


The system s functions are deployed and registered In are 
Members ofa COl who can use them. 


acce ssed 


No Eve iprise Servbe Bas kt tsedby the ¢ stem. 


ares 


ome of te bask semwkes ofan ESB. No specitec p 


Proprietary mle 
ypliance. 


P 
are hh place Be asare eat co 


Vy hetcan provide best services D he pavorm. Some standaras 


4n ESB Is Implemented using wdely used open standards that provide all the netcentric 
core services as well as critical évent prosenng security services and autonomic 
capabilities. Mostot the system's functionallty|s Implemented as services. 


COTS ESB that can mediate dyrank request ard math Gos 
6 Ik 2ot-feal tine, bear real tine avd teal tne and Interact with 

: 0B ke verted and certtted © provkle 
PTA nce processes 


icecaire Desed on 


POOR Roe a interac 
ap Dwal- de 8 a 


aTeces? 


The system bb ty bt Integrated ard rot modular. 


bs Ticked of well 
specie B the pr 


The syst k ¢ 
are propre tary 0 


ceTae cd mocleks with wellceted Interfaces, bat the Inemtaces 
Jian. 


cl ot yell 
0 STIGAGS @y 


d Intertaces. 
dL 


The system Is constructed of well defined modules with well det 


) - Nntertace s 
are based on widely used open standards and conslstent with the « 


ambaly discowred semkes or through 
merted by thk system are dephyed ard 
me at ancl accessed ishg : 


Planned and se ecced Anaver 


Access k sotinpkme se dbythk system. Plan ned 


INS SYSRM GIWIES SOME, OUTHO Tal OF TH NSE SRIGHGS 


This system Implements and uses Web Access using mostor all ort 
thelr current Torm. The standards used have been veritied ti 


Achieved | 


nd Wad ze Cass in 
2cnces: HTTP Same Manag anit 
anes such 2s HTML (MH TUL), Wad Dismitxiced Autioring a 


tedhtk system. 
Thk stm Wtltes db tbred component batiotweb sembkes. 
TINS SYSHM WINIES Some, Dutho Tall of he NsAd sen aaa 
Thk stm Mpkmert ard ses Web Sekes ishg mostorallotte Ik ed staacarck. 


This system utilizes Web Services standards and also utillzs s Grid computing standards. 


a4 BD access Mmpvean aired Dy ? pe oor 
m aspeces, ve e+ @ La nsuage 
ML Pati Langiege (Paty. 


$$ bor Servkes b Inpkmertdh tk sytem. 
The syetm wtibes dk bred com poreit bitrot web semkes 
INS SYSEM GINIES SON UTHO Tay OF TS VSR SRT GaGS 


Thk system Mpk mest ancl ses V eivkes isl mostorallotte Iked staactarcts . 


This system utilizes Web Services standards and also utill2s s Grid computing standards. 


Transfer 


wan gquege 


Planned Answer Esectd An 


cl Aaswer cor 


Thk syetm wtltes Web ck ardako itite 


os 


semkes are rotimpkmested Ie th system. 


Are Wad services products ¢ (VS) Basic 
e 


selves are sotimpk me ated la th syetem. 
$ tata wed are mpkmered wit propre tary Ine ree 


WED SAY VICES US PYOHHCS NeTave COMMIANT OUTCONTguVveTON 


mars of Sarw cas d anoyed Dy Cis Syscam are ape cred 
semkes are sotimpk mented In th sytem. 


Uskiown &stmatd. 


Empirical ewoence shows he the sysemcan supotie emecednumber ora 


clon of Increased asage and will avtmatically Increase 


cas dapvoyed by Cis syscam per hour (or par some 


hes are sotimpk mented In th sytem. 


Uikiown estima 
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aromate 
nar enw 


On WAC 2SSLm | 
ot linpk tm 
Unkiown stated. 
SagP MNSiVYy 


Hardware ancl software follies are ib place B® scak al pmatcally BD meet teaye ard had 


mance anaiysis has Dean done co undewstand a predycc tie aw 
/@ x oO “us 


jetvkes are sotimpk mented lb th syetem. 


Uskiows &stmatd. 


MOV ICA CWGRICE SINS TR TNE SYS 


Hardware and software taciittes are Ib place  scak aibmatically meet usage ard bad 
qulreme rt. 


7 done co undesiand ow prearct tie 
ces? 


selves are sotimpk mented ls th system. 


pestnatd. 


SYSEM CaN SU PONTE exmecea num 


are Ib place ® scak aibmatkally ® meet sage and had 


earons pan? Evac tation plans are Ib place ,batservie wouklbe dk rapted darlg aa emerges, 
Nopla k lt place 
Batic plan allows tor MTBF ancl MTB tecovry. No testhg plank lb place. 


BARC VAN BNOMIS RN MCW IS (ECOVETY. (ESTING DAN IS 0 Dace and eC Se regularly Whatpercenct & Cweerscenaios have bean idanctied and validated fo 
design? 


No threatsce sarke have beer couskkred Ib te plarahg. 
pas plan ke tb place ancl tt is exercked on a regular backs wrth Approximate y 25 perce st ofthre atscerarks have bee a cons klered In the planal 


ADO MR TAY OU PEYCEN TOT INP ATSCEN aS Nave OBEN CONSETEI mM mM penwng 


Nopka k place. A robastset ofthreatsce sarke bas bee a conskleredt It the plans 
Schedtk dowtages. 
duk dottages. Reqularbackips aid @st ofhack tps k do 
E2ckup system $ are used co cavry load wie prim e sy scam is Mamnained. Synchron=zce 
ual and requires man im tie soap. 


Backip syeteme arm aract th cars net whi nrima metam kt maltahert mackroabatoy 
arome 


Achieved matches Planned 


Oo prowding sarwee dur wet Tasw ve CUages of i PIMC agic Hatvil sense handva valaliy butcannotacdaprand val, tus only 
a descvucc g i c 


Nopha k hb place. 


Off te backip and arches. Secondary ste bas bees klentited tb recomyare and restart MTBR w se ce adap We ene ps 1a broad rr of ban chwktt! 
- 1 clay. n ‘] vie vilroament Meo 


H® has been identted 2 : 


Does cle syscan & davery of ca apa iges co Cw oO 
aspecally Clase cacy Je adapaxnity Coa vari ely of disadvanceged eda 
The program can only sapporte Ikatserver environment. 


The program reqabes high barcwkit © sipport thh or browser-hasedl cleat via sewkt oF 
port. 


The prog ran may stpport iow bar cwkith © thls or browse has edclkat viaservkt orportkt. 


THe | program does suppaYT/ay Oandwydo Co Cin oF Drowse-Desed Giants We se wets ow 
porc Jecs. 


med and sal ecred Anaver ick Dexpeckd 


Does Cie program have? cononurgy of opererons plan? 

Nopka k li place. 

Base plat allows tor MTBF ancl MTB recovery. No testhg plan kk ib place. 

SASS PIE aWOWIS TY IW Sr ana is recovery. /estng pe Dace ang eercisea reg 


4 continulty plan Is In place to assure minimal MTBR Including regular backups and 
testing. 


onthetty of qpe rations plas & lb place and It exercked on a requiarbask wit 
ako verted. 


Noplat k ib place. 
eduk dortayes. 
Scheduk dovtayes. Reqularbackips and @stothack «ps kb done. 


is Manua and requires man m Tie/oap. 


Backap sys 
arpome 


Achieved matches Planned 


Nopla k lt place. 
Ott te hack ap and archWes. Secondary ste bas bees Klentted ® rmecomgare and restart MTBR 
~ day. 


cd arcin ves. Secane has be ienited D recontgure and resayt MTBR 


ant barck secl ste with aromatic allover. No dire 
Ibraed. 


= Apswe 

supp pans imcwae sn] = SHSWer 
Selected Answer 
Planned Ansaver 


Planned and sal ecred Anaver 


- 


Bvac tation plans are Ib place ,batservike woukl be dk rapted carla as emergescy action. 


ves, Emergency support or evacuation procedures are In place and tested on a regular 
baals. 


Whacpercanc of cirezr 

dasrgn? 

No threatsce sarke have been coaskk rect lt the plaa 

Approximate ly 25 pe roeat of thre atscerarke have bee a consklered It the planahg. 
ADLYOM M@ THY OU PAYCANT OT TINE ATSCENaNI0S NAVE OSSn CONSGeTed IM M panning 


roslmately 75 perc ent of threat scenarlos have been considered In the planning. 


A robastset ofthreatsce sarks bas bee a cons klered le the planahig. 


) Variety and 


gic tatvall sense | 
NTS ANG POTN Tay | 


The will seve adapt ® delkerhg erchberd capabilites ovr ab 
(rom bw bitrate tetical comm anrk $ ® matty) Yabtt backhoe 
vkes PDAs w 


Does cle spscan of capetre 
aspecally Clase Ciacpy 
for and-cisars? 


ort this or browser-based cleat vila sewkt or 


The program may s apport low bas cwkith ® thi or browse thas edclkat viaservkt orportet. 


gram does supporcic Hendwidd) co Cin oF Oraaiser-besed avencs we sey Wecs or 
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Automatic and dynamle scalability, seltcontiguration, self-healing, sélt-dlagnosing, and 


uniform error logging and rece are enabled across the net-centile environment. 


Semke Buel agreeme st are lac 
ruatine tse. 


d prodenvow age 
Service management Information, Including per®rmance metrics and problemio 
status Information, will be made available to consumers and providers of the service. 
SL¢s are part of the sembke —— and ale hage d on opel a The © 


th aprovkler 
itk cor semke 


are prococal’s and standards Demng used Co cal ecrand dissammere sa wee 
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It service Management Tunction Is provided, standards used ® collect and disseminate 
bag i ial aellana and In what format will Itbe m ade avallable (¢.g., SNMP, 
AMAL, htt 


% are part of the ¢ yor aad are based o b stancank. The 
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B Root Category FitstCaegoryekment 


pated Catgonek me at 


mined and sel ecred Anaver 


owded complered examples of a Sarwee Level Agreamancs 


der with all other service providers and consumers wth which It will 


25 Total 
Questions 

Max possible 
score = 25 x 100 
point per question 
= 2500 

Planned 38.4% 
Achieved 76% 


Observe — 


—Does not have to 
approach max, just 
meet or exceed 
planned 


Score Surmimmary 
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Vision Net-Enabled |) 2% 
Industry working together with our customers to Future Ey rE 
provide a network centric environment where all 
classes of information systems interoperate by 
integrating existing and emerging open 
standards into a common evolving global 
framework that employs a common set of 
principles and processes. 


Today: 
Stovepiped Mission 
Systems, Our mission is to facilitate the global realization 
Point-to-Point of Network Centric Operations. We seek to 
Networks enable interoperability across the spectrum of 


joint, interagency, intergovernmental, and 
multinational industrial and commercial 
operations. NCOIC is global, with membership 
open to those who wish to apply the vast 
potential of network centric technology to the 
operational challenges faced by our nations and 
their citizens. 
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NCOIC™ exists to facilitate the global realization of Network Centric 
Operations/Net Enabled Capability. We seek to enable interoperability across 
joint, interagency, intergovernmental, and multinational industrial and commercial 
operations. 


Global Organization 
Voice of industry 
Cadre of technical experts 


Dedicated to interoperability 
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ee 
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a non-competitive environment 


In the photo: BrigGen Dieter Dammjacob (DEU AF)-J3 NATO Supreme Headquarters, Allied Powers Europe; Lt.Col. Danut Tiganus-ClIS 
Directorate, EU Military Staff; Dr. Tom Buckman-NC3A Chief Architect; Gen Harald Kujat,-German AF (Ret.) former Chief of Staff of German 
Armed Forces & head of NATO Military Committee, Marcel Staicu-European Defense Agency NEC Project Officer . 


NCOIC Members 


= 80+ Member Organizations | 
including leading IT and Aerospace & | ee 
Defense companies, government ~ a 
organizations, non-governmental 
organizations and academic 
institutions 

= Members from 18 Countries 

= Advisors from 26 key stakeholders 
from Australia, EDA, France, 
Germany, Italy, NATO, The 
Netherlands, Sweden, UK and US 


Tennant Terry Morgan honors outgoing Advisory Council Chair, Keith Hall 
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= NCOIC facilitates interoperability by collaboration 
= Member organizations & Advisory Council 
= Our member’s customers 
= Agencies of global governments 
= Other NCO stakeholders 


= Collaboration occurs through 
= Invited Review of developing documents & architectures 
= Joint demonstrations and white papers 
= Joint and hosted forums, symposia and workshops 
= Joint technical development with stakeholders 
= LOI, LOA, MOU, CRADA and other agreements 


Photo and screen captures from member lab 
interoperability demonstration, Rome, May 2010 


NCOIC provides guidance for network centric standards and their patterns of use. 


Global Stakeholders 


Sn ee Za 

~ CDRFredvanetinger,(NLDN) 
C2 Centre of Excellence, signs 

Letter of Agreement with NCOIC 


a 
Members develop a SCOPE™ workshop for 


Australian Department of Defence with Rapid 
Prototyping Development & Evaluation organization 


European Defence Agency Deputy 
Chief Executive for Strategy 


= “The Australian Department of Defence is a keen supporter of NCOIC, its principles and 
tools. We aim to apply NCOIC’s products to our acquisition process to better define 
interoperability requirements and improve through-life systems integration prospects.” John 
McGarry, Australian Air Commodore. 


» "We have used NCOIC’s NCAT™ tool to assess levels of interoperability during NATO 
Response Force exercises. Our Centre of Excellence found the tool to be very useful in 
establishing the level of interoperability." Commander Fred van Ettinger, Section Head of 
the Multi National Command and Control Centre of Excellence. 


» “NCOIC has four characteristics which make it unique. The organization is solely dedicated 
to network-centric operations and interoperability; its membership stimulates discussions 
about global interoperability; it serves as a ‘vendor neutral’ forum, and it has a cadre of 
industry’s top technical experts who are available to do its work.” Jack Zavin, U.S. Office of 
the Assistant Secretary of Defense, Networks and Information Integration. 


Relationships 


P| Gove rm ment orale Computing at the Tactical (Battlefi 


=" Organizational 


mergency Response Levels — 
‘a European Perspective 


Australia Defence Organization (ADO) 
Eurocontrol 
European Defence Agency 
NATO 
° ACT 
* NC3A 
* NCSA 


Netherlands Command & Control Centre of Excellence 
Sweden Civil Aviation Authority (LFV) 

Sweden Defence Materiel Administration (FMV) 

US Defense Information Systems Agency (DISA) 

US Department of Homeland Security (DHS) 

US Federal Aviation Administration (FAA) 

US Joint Forces Command (JFCOM) 

US NAVAIR 

US SPAWAR 

OSD(NII) 


Australia Defence Information & Electronic Systems Association (ADIESA) 
NATO Industry Advisory Group (NIAG) 


2008 IDGA Award: 


OASIS Outstanding Contribution 
. . . to the Advancement 
World Wide Consortium for the Grid (W2COG) duce Cantic Wein 
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Addressing Inter-Agency, Cross-Industry NCOG@ 


= Systems, Capabilities, Operations, Programs, & Enterprises (SCOPE™) Model 
— Characterization of commercial, civil, and government requirements for interoperable systems 


= NCOIC Interoperability Framework™ (NIF) and Net Centric Patterns 
— Recommendations for open standards and their patterns of use to obtain interoperable systems 


= Building Blocks 
— Catalog of COTS & GOTS open standards based products compliant with NIF recommendations 


= Network Centric Analysis Tool™ (NCAT) 
— Netcentric analysis of system architectures, including System-of-Systems and Federation of 
Systems architectures 


= NCOIC Lexicon 


— Aglossary of terms and definitions that lay the foundation for meaningful discussions. Provides 
a common language for the disparity of ideas concerning key terms, including "NCO.“ 


= Systems Engineering best practices and processes 


— These best practices and processes include tools, process and maturity models, modeling 
techniques, and collaborative environments for NCOIC integration. 


These products, combined with NCOIC member expertise in NCO/NEC, 


measure netcentric capabilities ,requirements, gaps and provide 
recommendations for interoperability 
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Part of Procurement Process 


Advise Participate _ Adopt Require 


2004/2005 
* NATO C2COE NRF 


= All Advisory ; spur on nie 
Suet nannies —NCAFT - USAF SPACECOM 
¢ DISA (US) — NCAT 
ila ae —CRADA ¢ FAA/Eurocontrol 
— OSWG — SCOPE/NCAT/Pattern 
— NCAT Ss — | 
¢ OSD-NII (US) — FAA OTA 
_ NCAT * US DoD ¢ Aus DoD/RPDE 
— OSWG — Net-Centric 
— Cybersecurity Attributes 
¢ FAA/JPDO (US) ¢ Australian DoD 
— Aviation IPT — SCOPE/NCAT 
(NextGen/NEO) — Patterns/BBs 


NCOIC is Pursuing Plans to Further Increase Influence in Future 
Procurements 


NCOIC Terms 


= Network-Centric: 


— Related to systems and patterns of behavior that are influenced significantly or 
enabled by current and emergent networks and network technologies. Often 
these center around IP-based internetworking, but the term is sometimes used 
to include any type of enabling network. 


= Network-Centric Operations (NCO): 


— An information superiority-enabled concept of operations that generates 
increased combat power by networking sensors, decision makers, and 
shooters to achieve shared awareness, increased speed of command, higher 
tempo of operations, greater lethality, increased survivability and a greater 
degree of self-synchronization. 


Net-Centricity Requires Interoperabilit 
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= (DODINATO) The ability of systems, units, or forces to provide services to, and 
accept services from other systems, units, or forces and to use the services so 
exchanged to enable them to operate effectively together. (Joint Pub 1-02) 


» (DOD only) The condition achieved among communications-electronics 
systems or items of communications-electronics equipment when information or 
services can be exchanged directly and satisfactorily between them and/or their 
users. The degree of interoperability should be defined when referring to 
specific cases. (Joint Pub 1-02) 


= (NATO) The ability to operate in synergy in the execution of assigned tasks. 
(AAP-6 [2005]) 

= (IEEE) ... the ability of two or more systems or components to exchange 
information and to use the information that has been exchanged 

= (Wikipedia) Interoperability is connecting people, data and diverse systems. 
The term can be defined in a technical way or in a broad way, taking into 
account social, political and organizational factors. 


= t's the opposite of system-centricity and enterprise integration 


» t's about dynamic crossing of system and organizational 
boundaries to achieve objectives 
— Greater operational effectiveness through better use of what already exists 
— not just what you “own” or control 
= It's not about the network — it's about who and what you can 
interact with via the network for your purposes when you need to 


= It challenges existing business/acquisition and doctrinal 
paradigms and incentive models — more revolutionary than most 
realize 

= It challenges system-centric system engineering and 
architecture paradigms 
— It similar to the relationship between ecology/evolution and biology 
— How do you engineer parts that support a variety of architectures? 


Net-Centricity — a full contact social sport 


NCOIC Assists Customers 
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CUSTOMER I To AcHIEY SOLUTIONS TONEEDS WA casspi ine 
GOALS fg 'OACHIEVE (EXISTING AND FUTURE) CAPABILITIES 
erey NES & SERVICES 


Typical Process Steps to Solutions: 


NCO Initiatives Database —_) 1, Analysis of Alternatives eee 
2. Requirements Derivation Quality 
SCOPE Model 3. Requirements Validation of Service 
NCOIC Interoperability Framework (NIF™) 4.Besign Synthesis Network 
N Centric 
The NCOIC SCOPE ™ Model C hb 
provides a descriptive framework for ie aa (NCAT™) 
characterizing the net-centricity of 
systems, capabilities, operational T Building 
requirements, capabilities, programs 5. DESIGN VERIFICATION Blocks 
or enterprises 6. Deployment (BB) 


7. Support 
8. Upgrade or Disposal 
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What is the SCOPE Model? 


» Systems, Capabilities, Operations, Programs, and Enterprises 
(SCOPE) Model 


= SCOPE gives customers and companies the means to characterize 


interoperability requirements for 
network centric systems 


How isolated or connected are the systems to each other? 


How isolated or connected are the systems to their 
environment? 


What are the intended purposes of the connection between 
systems? 


What portion of operational space do the systems address? 
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= Charter: 


— Develop and evolve a means to characterize requirements for network 
centric systems, capabilities, operations, programs and enterprises 

— Work with Functional Teams, IPTs and WGs to enable and learn from 
application of this characterization to actual pattern development 
(operational, capability, and technical patterns) 


Measures of 
Satisfaction 
Measures of Measures of Net- 

Effectiveness Centricity 


Measures of Maturity 
Performance and Risk 


Miscellaneous Size, Weight, 
(the “ilities”) e; Power, Cooling 
Cos hedul 
Cost & Schedule 17 


Why SCOPE? 


First need to understand Net-Centricity and what is driving it 
— Asingle system can't be net-centric; other systems provide context 
for its net-centricity 
Also need to understand what systems are and how they relate to 
institutions that sponsor them 
— Objectives and Contexts 
— Scope of those objectives and contexts 
Perspectives on those contexts, including externally driven contexts 


Frames of reference used to describe contexts and perspectives in 
systems that support them 


Need to understand that all systems having information service or 
communication capabilities are models of operational space 
— All models are wrong and incomplete (authoritative or not) 
— Some models are useful in some contexts for some objectives 
— Degree of model coupling to various contexts can vary 18 
— Models have institutional and operational scope and context 


Bde alla @)y-e-1ie-Oce-lnrziveacee Our willingness 


Operate and ' 
bree in a net- Biologia) & Culture to change, trust, 
delegate and enable 


enabled environment é — and why! 
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Technology is important, not in itself, but 
as an ENABLER (and a limitation) 
for achieving the benefits of NCO 


Layers of Interoperability 


Harmonized Strategy/Doctrines 
Aligned Operations 


Semantic/Information Interoperability 
Data/Object Model Interoperability 
Connectivity & Network Interop. 


Physical Interoperability 


People & 
Process 


Information 
Services 


Network 
Transport 


Organizational 
Interoperability 
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Technical 
Interoperability 
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High Level Models 


Domain Specific Node 
General Architectures 
Architectures 


On-time Cargo | . 
Delivery 


a domain’ Ss needs and capabilities in many _ Iailorea 
dimensions that relate to interoperability 


Qos 
Cost Transfer Rate 


(Illustrative of a great 

simplified SCOPE anal 

actual SCOPE Model Net S t 
and associated tools Awareness ecurity 


my dimensions in 

depth) 

Autonomy 
Capability 


Service Orientation 
Scope 
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Models of The SCOPE Model Domain Specific Node 


High Level Models Customer measures needs of each General Architectures 
Objectives domain in many Architectures 
dimensions... 


| | On-time Cargo 
| Delivery 


obs | lima 


Cost os Uva 


Net Awareness Tailored 0) 
Security a 
Tailored  |teroperable? 
Autonom 


Service Orientation 
Capability 
Scope 


/| Fuel Efficient -~ 
ooo 
... and each domain ofte 
has different 
needs, characterized 
via the SCOPE Model 


SCOPE Model Overview 


Systems, Capabilities, Operations, Prog 


Enterprises (SCOPE) 


An enterprise has scope in operational, time, resource and other domains 
So does a capability, which may involve multiple enterprises 
A capability is the potential to conduct operations of a certain type and scope 


Most enterprises have multiple capabilities and use them to varying degrees to 
achieve enterprise goals in conducting operations 


An operation is a kind of enterprise, usually with more limited time span and 
goals 


— But some operations dwarf many traditional “enterprises” — e.g., Iraqi 
Freedom, WW Il 


A program is a mini-enterprise/operation focused on building a system that 
provides some capability fragment for a larger enterprise 


A program may be responsible for developing multiple systems needed for a 
capability (e.g., a Lead System Integrator (LSI) program) 


— More often a capability is implemented through multiple systems under 
heterogeneous sponsorship ( Lead Capability Integrator?) 


Net-Centric Architecting encompasses both single program capability 
engineering and multi-program/system/enterprise interoperability 34 


SCOPE Purpose 


= Provide a measurement framework for describing to what 
degree a set of Systems/Services supports a Capability, 
Operation, Program or Enterprise (SCOPE) over a network 


— Whether the set constitutes a family of systems, a system of 
systems, or just an ad hoc grouping is contextual and a matter of 
degree 


— Can involve multiple capabilities, programs, or enterprises 


— Helps define the scope and diversity of the systems in a given 
context 


¢ Highlights nature of issues affecting system interoperation 


— Helps identify how a given system could better support the larger 
context in a net-centric ecosystem (“scope creep”) 


How open are the systems to each other and to their 
enviroment and what purposes do they support? 25 


SCOPE Model Features 


= Net Readiness Dimension set 
— Measures how open and adaptable component systems are to 
working with each other over the network 
= Capability/Operational Scope Dimension set 


— Measures how broad, deep, and diverse the operational 
architectures are that the systems are designed to support 


= Technical Feasibility Dimension set 


— Measures how feasible it is to achieve desired operational 
capabilities, given the systems and their information exchanges over 
the available network using established technical standards and 


infrastructure services 


Net-centricity is not free, adaptability is purpose-driven, 
and the network is only somewhat transparent 
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“Intergalactic Radiator” 
by Capt Yurchak 
For SCOPE illustration only 


Tactical C2 MCP 
ISR MCP 


Navigation MCP 


Individual 
Programs/Systems 
or System of Systems 


Missile Defense MCP 


ies wie MCP oe 


= 
Operatic wel Ly 


Systems of systems often 
aligned to these capabilities 


+-—— Enterprise ————> 


Current Navy Warfare Sponsors 


EXW SUW USW 
N75 N76 N77 


Budgets 


often in Shes of page 


tated vertically 
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Narrower Scope 


Overall Scope and Single Service or DoD-Wide World-Wide 

Types of Enterprise Agency 

Capability Breadth Single Functional Multi-Domain, Multi- | Multi-Dept, NGO, Coalition, Multi- 
Domain/Service Service Industry Enterprise Type 

Capability Depth Single Level Two Levels Three Echelons Four or More 

Echelons 

Organizational Rigid Hierarchy, Adaptive Hierarchy, | Flat, Empowered, Adaptive, Social, 

Model and Culture Vertically Integrated nteract Horizontally | Open to Partnering Interdependent 

Unity of Life Cycle Single DoD Acquis. Multiple DoD DoD & US Syst. Multi-National Syst. 

Control/Alignment Exec Acquis. Exec Owners Owners 

Acquisition All Systems on Same | Timeline within 2 Timeline within 5 Timelines >5 years 

Congruence (SD) _ | Timeline years years apart 

Semantic Single Domain Multi-Domain Single Language Multiple Languages 

Interoperability Vocabulary Vocabulary 

Operational Single Ops Context Multiple Ops Future/Past Hypothetical 

Context (SD) Contexts Integration Entities 
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Narrower Scope 
Dimension 


Overall Scope and Single Service or DoD-Wide World-Wide 

Types of Enterprise Agency 

Capability Breadth Single Functional Multi-Domain, Multi- | Multi-Dept, NGO, Coalition, Multi- 
Domain/Service Service Industry Enterprise Type 


Capability Depth Single Level Two Levels Three Echelons Four or More 
Echelons 
Organizational Rigid Hierarchy, Adaptive Hierarchy, | Flat, Empowered, Adaptive, Social, 
Model and Culture Vertically Integrated Interact Horizontally | Open to Partnering Interdependent 
Unity of Life Cycle Single DoD Acquis. Multiple DoD DoD & US Syst. Multi-National Syst. 
Control/Alignment Exec Acquis. Exec Owners Owners 
Acquisition All Systems on Same | Timeline within 2 Timeline within 5 Timelines >5 years 
Congruence (SD) _ | Timeline years years apart 
Semantic Single Domain Multi-Domain Single Language Multiple Languages 
Interoperability Vocabulary Vocabulary 
Operational Single Ops Context Multiple Ops Future/Past Hypothetical 
Context (SD) Contexts Integration Entities 24 
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Speed and Access 
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| Purpose, Situational Understanding 


ies = Plan Development and Execution 
Objectives, 
Perceptions, Purpose, Situational Awareness ii 


Encyclopedic 
ete Intentions, Strategic Information Models 
Public Info 

Assessments . 
Models, And i= Operational Information Models 
Open Source Doctrine, ‘ 


Data Concepts, Tactical Information Models 
Effects, 


Processes “Sense-making” it 


a ‘ Data From Deployed/Tasked 
World Model Building Activities Dats CollactionAecatc 
a v1 


Phenomenology — Sensing the Real World 


Narrower Scope Broader => 


Current 


Proposed a 


Key Improvement 
Areas 


°Tactical Nets 
eLocal Gov Interface 


eRail modes 


=== Actual MOP 
" Threshold 


|__| Capability Scope Measures 


eSupport for Cross 


Domain Services 
=z Capability Specific Measurés 


Information 


Discovery 


Info Model Pre- 
Agreement 


Information 
Assurance 


Autonomic 
Networking 


Semantic 
Interoperability 


Tighter Coupling / 


Less Net-Readiness 


Static Indexes 


Complex data 
& doctrine 


Link encrypt - 
SSL 


Design Time 
Configuration 


No Explicit 
Semantics 


Metadata 
Navigation 


Standard XML 
Schemas 


Single sign-on 
support 


Run Time Re- 
Configuration 


Semantic 
Metadata for 
Interfaces 


Relevance 
Measures 


Business 
Object 


DoD-Wide 
PKI support 


Dynamic Net 
Management 


Ontology- 
based 
interfaces 


Looser Coupling / 
More Net-Readiness 


Context-driven 
Search 


ASCII, URLS 


MSL, cross- 
domain spprt 


Adaptive Net 
Management 


Dynamic 
Ontology 
mapping 


Smaller Risk Larger Risk 


Dimension 


Inter-System Strategic Tactical Transactional Real Time 
Time Binding to 

Achieve 

Capability 


Run-Time <1% of existing 1-10% 10-50% >50% of existing 
Computing system resources system 
Resources resources 
Needed 


Service Mgmt. Negligible Within Current Within Planned Beyond Planned 
Resources Net Service Net Service Net Service 
Needed Capacity Capacity Capacity 


Net Resources Negligible Within Current Within Planned Beyond Planned 
Needed (FD) Net Capacity Net Capacity Net Capacity 
Interface <1% of system 1-10% 10-50% >50% of system 
Development size size 

Complexity 

Technology TRL Levels 8-9 TRL Levels 6-7 TRL Levels 4-5 TRL Levels 1-3 
Readiness Level 

For Net Use 


SCOPE is a comprehensive, balanced approach to assessing sets 
of systems from a net centric operations perspective 
— Evolved through application against real programs 


— Yet has an overarching perspective on the problem space, semi- 
orthogonal to architecture frameworks (FEAF, DoDAF, Zachman, etc.) 


SCOPE is a “Goldilocks” model 
— No preconceived value for any given degree of net-centricity 
— Value depends on operational objectives of target system sponsors 
¢ Desired degree of agility 
¢ Desired degree of operational/resource scope 
SCOPE has potential to be a net-centric content-based 
complement to CMMI to characterize what is built vice how 


— But focused more on “best fit” to the problem domain rather than 
“maturity” or “level” based 


SCOPE Relationships 


= Relationship to other NCOIC Teams/Products 

= Perspective, Context, Scope, Domain, Frame of Reference, State 
= Net Centric Principles and Attributes 

= SCOPE & Net Centric Principles and Attributes 

= SCOPE & Acquisition 

= Architecture, Patterns, and SCOPE 

» SCOPE & Systems Engineering 

= SCOPE & Operational Effectiveness 

= NIF & SCOPE 

= SCOPE & Net Centric Principles and Attributes 


Relationships with Other NCO 


= NCOIC Interoperability Framework FT 

— Characterize ODs in “size” and relationship space (to each other) 

— Help develop/scope Operational Description (OD) content 

— Provide way to characterize relevance of patterns to ODs 

— Owns autonomic dimensions (structure of information needed about 

the network and participants) jointly with SIF WG and Mobility WG 

= Specialized Frameworks FT 

— SIF WG Owns Discovery and Semantic Interoperability dimensions 

— Service WG owns Service related sub-dimensions 

— IA WG Owns IA Dimensions 

— Cloud Computing WG is developing domain-dependent dimensions 


— MN WG Owns Network Utilization Dimension and supports 
autonomic dimensions involving network mobility (e.g., COOP, QOS) 


= Network Centric Attribute FT 


— Primary internal source of criteria for analyzing degree of net- 
centricity in requirements contexts 


— Drives NCAT Tool features to support SCOPE workshop processes 39 


Relationships with Other NCOIMg 


=» System Engineering & Integration FT 


— Support conceptual and process integration of SCOPE model into 
overall NC engineering process model (e.g. Practitioner’s Guide) 


— Support development of net-centric attributes appropriate to Test and 
Evaluation contexts 


= Modeling and Simulation FT 
— Owns dimensions/attributes related to “alternate reality” contexts 
BB FT 


— Uses selected SCOPE dimensions to characterize scope of applicability 
of Building Blocks to specific ODs, use cases. 


IPTs 
— Apply SCOPE analysis within each IPT to define bounds of IPT charter 


or OD and help decide degree of net-centricity appropriate for each use 
case (apply “Goldilocks” principle) 


— Determine degree of applicability of net-centric patterns developed by 
an IPT — e.g. Sense & Respond Logistics OD and patterns 
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Key Definitions 


Operational Context: The attributes which characterize an entity's 
purpose & state, within some scope, often shared with other entities 


Perspective: a particular system's or individual’s version/view of some 
context/entity for its purposes 


Frame of reference: The representational convention used to describe 
some entity along one or more attribute dimensions, including context 
attributes 

Scope: the portion of possible real world and conceptual entity space a 
given system, context, perspective, or frame of reference includes 
State: The value of context and other variable attributes for an entity at 
some time or interval in some frames of reference 

Domain: A named subset of functional/operational space with specified 
scope and specialized perspectives and frames of reference for 
describing operational context and state, shared among some entities 
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Key Definitions 
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= Principle -- A basic generalization that is accepted as true and 
that can be used as a basis for reasoning or conduct. 
= Attribute, property, dimension -- a construct whereby objects or 
individuals can be distinguished from each other 
— |.E., They are observable, and, ideally, measureable 
= Characteristic, feature -- A prominent aspect of something; a 
distinguishing quality 


= Simply put, ‘principles’ allow the selection of ‘attributes’ or 
‘characteristics’ that are deemed useful for certain contexts 


= ‘Characteristics’ or ‘Attributes’ are used to distinguish or select 
systems 


= Thus, in identifying the core principles of net-centricity the goal is 
that these ‘principles’ may be used to select essential and 
relevant characteristics and attributes of net-centricity. 
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Net Centric Principles and Atti 


NCOIC has a multiplicity of principles, e.g.: 
NIF Architecture Principles 
Net-Centric Services and SOA Principles 
— Mobile Networking Principles 
— Information Assurance Principles 
All these principles assume a specific application context, namely: 
— Architecting, services/SOA, mobile networks, security architectures 
NCOIC also has a Position Paper with a definition of net-centric 
operations 
But all these principles and definitions still represent net-centricity 
from a somewhat scope constrained perspective 
Review of the DoD Net Centric Attributes drove the development of 
a draft set of principles that are fairly scope/context independent 
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Net Centric Principles 


= Explicitness 
— An entity should make all information about itself explicit 
= Symmetry/Reciprocal Behaviors 


— Relations and entities should exhibit symmetric characteristics 
and behaviors 


= Dynamism 

— Entities should support dynamic behaviors 
= Globalism 

— There should be no a priori bounds on the scope of applicability 
= Omnipresent/Ubiquitous Accessibility 


— Entities should have omnipresent or ubiquitous access to 
resources (i.e., each other) 


= Entity Primacy 
— Entities have existence distinct from the contexts in which they 
participate 
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Net Centric Principles 


= Relationship Management 


— Relations among entities should be explicitly represented and 
provide for negotiation, creation, change, and termination 


= Open World 


— Entities should allow for open-ended representations and 
Interactions with other entities; extensibility and scalability 


= Pragmatism 
— The ability to improve operational effectiveness is paramount 
— Trumps the other principles 
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Internet & World Wide | Adapting Internet & World Wide Web constructs & standards with 
Web Like enhancements for mobility, surety, and military unique features (e.g. 
precedence, preemption) . 


Secure & available Encryption initially for core transport backbone; goal is edge to edge; 
information transport | hardened against denial of service. 


Information/Data Producer/Publisher marks the info/data for classification and 
Protection & Surety handling; and provides provisions for assuring authenticity, integrity, 
(built-in trust) and non-repudiation. 


Post in parallel Producer/Publisher make info/data visible and accessible without 
delay so that users get info/data when and how needed (e.g. raw, 
analyzed, archived). 


Smart pull (vice smart | Users can find and pull directly, subscribe or use value added 
push) services (e.g. discovery). User Defined Operational Picture vice 
Common Operational Picture. 


Information/Data Information/Data separate from applications and services. Minimize 
centric need for special or proprietary software. 


Shared Applications & | Users can pull multiple applications to access same data or choose 
Services same apps when they need to collaborate. Applications on 
“desktop” or as a service. 


Access to the information transport, info/data, applications & 
services linked to user’s role, identity & technical capability. 


Tailored for information form: voice, still imagery, video/moving 
imagery, data, and collaboration. 


Based on Invited Review of the US DoD Net Centric Attributes 


To be published shortly 


Generally less implied US DoD context, more “generic” 
Rearranged some attributes and split them into multiple attributes 
Recommended adding some attributes for human 
interoperability and more non-technical attributes related to 
organizational relationships 

— No major changes from current DoD set otherwise 
Recommended developing a more comprehensive set of explicit 
assessment contexts for selecting and specializing attributes 

— Enterprise context (US DoD, NATO, NCOIC, RPDE, etc.) 

— Life Cycle Phase (of system/capability being assessed) 

— Type of System/Capability (Infrastructure, mission application, etc.) 

— Attribute Application Purpose (why are the attributes being applied) 
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| CTitle | eseription 
services or systems is decoupled from transport mechanisms. 

Open-Ended Pervasive Ability of system(s) or service(s) to find, use, and control information 

Accessibility (which requires an ability to identify and distinguish entities and the 
publication of information with minimal a priori constraints). 

Open Standards Based To support interoperability programs/projects, systems, and services 
must maximize the use of openly available and unencumbered 
technical and process standards that support media independence, 
pervasive accessibility, and trustworthy control of access to 
information and services. 

Protected and Assured Program/project, system, or service makes use of existing specified 

Transport Services assurance, protected, and defended transport services where 
feasible/available. Infrastructure systems provide specified 
assurance, protected, and defended transport services that are 
accessible and available wherever and whenever needed 


Producer/Publisher Trust Program, system, and/or service(s) has mechanisms for establishing 

Relationships [with users and |and maintaining appropriate trust relationships with users and 

services] services on the network. Measures are taken to comply with any 
security labeling, data protection, and access control requirements 
entailed by the trust relationships and monitor the environment to 
ensure that conditions on which the trust relationships were 
established have not changed 
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Post Data/Information for Program/project, system, and/or service(s) has made their products 
Network Access discoverable and accessible on the network in a manner and 
timeframe appropriate to the nature of the information/data. 


Adaptive Information Access |Program/project, system, and/or service(s) has provided users and 
services access to information and data in ways most appropriate for 
their context while allowing them to negotiate access arrangements 
and understand the associated costs. 


Information and Data Program/project and/or system has separated its information and 

Independence data from applications and services (dependencies) and is provided 
with sufficient context (i.e., metadata) to enable users to use the 
information/data correctly for their purposes. 


Tailored Resource Access Service levels can be modified, tailored, or negotiated to meet needs 
as represented by identities, roles, and/or contexts. 


Social & Cognitive Integration | Programs/projects and/or systems include measures of social and 
cognitive integration that facilitate their effective use. 
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= SCOPE provides a way to be more explicit about the scope 
assumptions under which a particular system/entity operates 

= Also identifies hierarchical or other asymmetric relationship 
assumptions in capability scope and net ready dimensions 

= Net ready dimensions focus on dynamism while capability scope 
define operational range across which one needs to be dynamic 


= Capability scope dimensions encourage global thinking 
= Net ready dimensions look at accessibility over the network while 


technical feasibility dimensions look at constraints the network 
imposes on ubiquitous accessibility 

= Capability scope dimensions are the primary means of exploring 
the application of the entity primacy principle 

= Both net ready and capability scope support application of the 
relationship management principle 


— Organizational Business Model and Culture dimension in particular 
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= The technical and economic feasibility dimensions support 
application of the scaling principle 


— So do the net ready autonomic and semantic interoperability 
dimensions 


= They also support the application of the pragmatism principle 


— Sodo the acquisition alignment capability scope, the net ready 
autonomic and semantic interoperability dimensions 


= Similar mappings of the principles to the Net Centric Attributes are 
provided in the Net Centric Attributes Invited Review paper 


— Also includes assessment context model, which is basically a subset 
of the SCOPE capability scope dimensions 


— Mapping is not surprising since the SCOPE model was influenced by 
the DoD Net Centric Attributes during its development 


51 


SCOPE & Acquisition 


= Most system/capability acquisitions have defined scope 


However, not all scope dimensions are typically specified 

Many are implicit in the acquisition source/context 

Some are encouraged to be “flexible”, “agile”, or “adaptable”, usually 
with little specificity as to type and range of flexibility desired 
SCOPE provides a way to be more explicit about scope and about 
degree of flexibility/agility desired and affordable 


= Some acquisitions are subject to external forces that can lead to 
changes in scope during or post acquisition 
— Can lead to significant ECPs and rework 
— SCOPE allows developers to consider such possible scope 


expansions/changes and anticipate them in the architecture/design 
¢ May not need to actually implement this flexibility 
¢ But anticipation reduces cost of implementation if the risk becomes reality 
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Integrated Architectures, Patterns 
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Integrated architectures represent a tight coupling between: 
— Specifically scoped operational views, 
— Operational functionality allocated to specific systems/components 
— Constrained by technical standards and infrastructure 
— And, presumably, available budget 
How this coupling would change if any of the view content 
changes is typically not explicitly represented/captured 
— May be done as architecture is being developed 
— Usually driven by the scope of the operational architecture 
— Other coupling factors do have some influence (e.g., available 
infrastructure, budget) 
Works well if the scope of each view type is fairly static for at 
least the development/implementation life-cycle 
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Changes in desired operational architecture functionality occur 
faster than the development life-cycle 


Scope of operational architecture is also dynamic 


Technology evolution and changes/variability in available 
infrastructure also undercuts static coupling to specific network 
capacity and protocols 
Coupling between scope decisions in architecture view types not 
explicitly represented 

— Change management becomes slow, difficult, error-prone 
Few integrated architectures survive operational deployment 
intact for very long 


— Requirement/Environment changes apply pressure to different parts 
of the integrated architecture 
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One solution is to make the integrated architecture capable of 
dealing with dynamic scope changes 
— Complex and Expensive 
— Difficult to justify increased scope and flexibility based on 
“contingencies” 
Another common solution is to develop a “reference” architecture 
— Decouples and defers some operational scope decisions 
¢ E.g., specific country or force element types 
— May also decouple some specific system component decisions 
¢ E.g., specific vendor or equipment type 
But it’s relatively unusual to find a new operational problem that is 
a complete match for the entire reference architecture 


— Difficult to use just “fragments” of the reference architecture because 
of implicit coupling between elements of the architecture 


55 


Enter Patterns and SCOPE 


= All too often the solution to these challenges is to develop a new 
integrated architecture using ad hoc architecture fragments and 
accumulated domain knowledge 

= Patterns are essentially partially (and explicitly) dis-integrated 
architecture fragments 

= Explicit representation of pattern scope allows semi-dynamic 
adaptation and composition into dynamic integrated architectures 

— Degree of design, install, or run-time composability for patterns is 
itself a scope decision driven by expected/desired level of agility 

= Different pattern types represent different coupling decisions 
between architecture view types 

= SCOPE is a way to represent the strength and types of coupling 
between architecture view types in a pattern (or architecture, etc.) 
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Capability Scope Technical Feasibility 


Dimensions Dimensions 
Can capability be 
Which Systems achieved with 
interact? current stds & 
About what? a technologies? 
How much? Battlespace | Are new 
And why? Representation and — standards 
To what effect? Naming standards Ep needed? 
Is the information 
Data element pete ; 
urate, ti 
Data models, Process Net-Ready standards, Technology - 
algorithms Dimensions Protocols, readiness levels 


Environments 
Systems | Open Technical 
View View 


How do systems interact? 
What standards are used? of 


What do systems say to each other? 
How ts this information represented? 
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= Operational Patterns 


— Specify a coupling among capability scope dimensions/value ranges 
and at least some technical feasibility dimensions (often implicit) 


— E.g., enterprise/capability type/scale, culture/business model, context 
flexibility, functional concepts, etc., and, say, time-binding dimension 


— Minimal coupling to net-readiness 
= Technical Patterns 


— Specify a coupling among and between net-readiness 
dimensions/values and technical feasibility dimensions and values 


— E.g., specific service discovery mechanisms and technical standards 
= Capability Patterns 
— Specify a coupling between all three SCOPE dimension types 


— E.g., specific functional services, naming standards, technical 
standards and infrastructure capacities required for a capability 
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Key Points 


= Patterns are architecture fragments with explicit scope 
representation of their (limited) coupling between architecture 
view types and ranges 

= Finer-grained than complete reference architectures 

= Coarser-grained than individual components and services 

= Net-Centric Patterns are those that rely on network connections 
and protocols, as well as net-centric principles, to connect 
components, services, people, and institutions to each other for 
some purpose(s) of defined scope 

«= Integrated architectures can be built/composed from patterns in 
less time and effort than from components alone 

— Patterns contain more domain knowledge than atomic components 

= Such integrated architectures are less fragile and more 
interoperable than those built for a single defined set of scope 
values 
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SCOPE is a system requirements elicitation tool with a pre- 
defined but extensible operational attribute model 


SCOPE provides a framework for defining the scope of one 
system in a way that allows comparison with the scope of another 
system 
— Provides a descriptive framework for augmenting system context 
diagrams with explicit scope 
— Also useful in being explicit about scope of system use cases 


SCOPE also provides a way to describe systems along a 
continuum from individual component to an enterprise of 
enterprises. 
— No hard definition of “System of Systems”, “Family of Systems”, or 
“Enterprise” needed 
SCOPE has limited SCOPE 


— lt only applies to those aspects of systems that are manifested in 


information/service request exchanges over a network - 


= Operational Effectiveness is often an elusive, subjective quality 

= Fundamentally, net-centricity is about increasing operational 
effectiveness by working with other systems/entities over a 
network 


— SCOPE does not measure operational effectiveness itself 
¢ That's best left to specific system/capability/process proponents 

— SCOPE does enumerate attributes that could be enablers or barriers 
to operational effectiveness in a given operational context and for 
specific purposes 

— Examining SCOPE dimensions of a particular set of 
systems/capabilities can help identify unforeseen barriers to, and 
enablers of, operational effectiveness 
— Adjacent domain analysis portion of SCOPE Workshops helps do this 


= NIAG SG-76 includes a report that describes a way to use 
operational effectiveness measures to identify important SCOPE 
dimensions for a given operational scenario 
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NIF & SCOPE 


The NCOIC Interoperability Framework (NIF) recommends using 
SCOPE to develop and specify the context and scope of 
Operational Descriptions (ODs) 
— ODs are high level descriptions of an operational domain 
— OD template is defined by the NIF 
— Contain: 
¢ Capabilities important to the domain 
¢ Purposes for the capabilities 
¢ Significant adjacent domains and domain interaction issues 
¢ Operational patterns and capability patterns 
SCOPE Workshops are used to help develop ODs and the 
adjacent domain analyses 


The NIF also points out that when there are multiple architectures 
interacting over the network, it’s important for them to explicitly 
represent their respective scopes to each other 
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= Workshops 


— Facilitated workshops using dimensions as structured interviewing 
and discussion capture tool 


— Practitioner's guide for prepping and conducting workshops 


— Leverages facilitator expertise and broader perspective to help target 
understand net-centricity in target context 


= Self-Assessments via questionnaire tool (NCAT, Spreadsheet) 
— May be helpful for targets already familiar with net-centric thinking 
— Generally not recommended for targets new to net-centricity 

= Informal application of dimensions in other review contexts 
— SCOPE dimensions used as completeness check by reviewers 
— May also generate suggestions/recommendations 
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Enterprise Integration, Strategic Planning, Re-engineering 
Program/System/Capability/Domain Requirements Elicitation 
— Operational Description Development 
— Pattern Development 
Inter-system/capability interface definition 
— Adjacent Domain Analysis 
Product Line Strategy/Design/Architecture development 
Characterizing scope of applicability of services and patterns 
Existing system/service re-engineering or evolution planning 
Standards development and characterization 
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NCOIC Resources for 
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= Practitioner's Guide and training material for SCOPE Workshops 
= SCOPE Excel Spreadsheet with SCOPE dimensions in the form 
of questions and potential answer values 
= Sets of domain-dependent scope dimensions developed for 
specific operational and technical domains 
= NCAT Tool capable of using SCOPE questions/answer content in 
a workshop format 
— SCOPE questions don’t use NCAT scoring features 
— NCAT tool capable of importing Excel SCOPE questions/answers 
— Including new domain-dependent questions 
=» SCOPE training workshops 


— For NCOIC teams developing operational descriptions and net 
centric patterns 


=» SCOPE training material such as this tutorial 
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» NCOIC Web Site: www.ncoic.org 
= SCOPE Model document available for down load from NCOIC 
public site. 
= Net Centric Attributes Functional Team email address: 
— net_centric_ ft@lists.ncoic.org 
— Chair: Hans Polzer, hans.w.polzer@|lmco.com 
— Telephone 703 416-2308 
— Vice Chair: Jack Zavin, jack.zavin@osd.mil 
— Content WG Chair: Todd Schneider, todd.schneider@raytheon.com 
Engine WG Chair: Leslie Anderson, Leslie Anderson@raytheon.com 
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Backup Slides 
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FFT Example 


SCOPE Model Process and Overview presentation — 
30 min 


Friendly Force Tracking Overview presentation and 
initial context/scope setting — 30 min 


Capability-specific SCOPE dimension development 

and selection of additional SCOPE dimension — 60 

min 

— What are the aspects of FFT by which its depth and breath 
can be characterized in terms specific to FF T/defense 
capabilities 

— What are the important adjacent domains with which FFT 
needs to interact? 


Overall FFT Capability Domain is very broad 


NCOIC focus on security operations still leaves this as a very 
broad domain 


Working with selected stakeholders, NCOIC C3 IPT will need to 
reach out to adjacent domains 


It's important when applying SCOPE to consider the larger 
environment in which a capability operates 


— Consider selective scope expansion to address interactions 
with adjacent and supported larger capabilities 


— End-to End Force Visibility, support from and to adjacent 
security operations, business and social incentive models for 
participating in a capability 

— Coalition versus Joint vs stability ops vs commercial/NGO 
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Identify stakeholders and domain experts for FFT 


— Focus on Operational Domain users and information architects more 
than system architects/developers/owners 


Use overview/reference material to identify relevant SCOPE 
dimensions 
Tailor SCOPE questionnaire/NCAT to focus on relevant 
dimensions — this is a judgment call! 
— Identify potential capability-specific SCOPE dimensions 
— Add questions that probe these dimensions to the questionnaire 
Schedule and conduct structured interviews using SCOPE 
questionnaire with identified stakeholders and domain experts 
— Capture specific answers as well as comments for “as is” operations 
— Probe for potential “to be” desires/possibilities in each question 
Conduct initial outbrief with FFT Initiative team 
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Conduct post-interview analysis to develop both as-is and 
candidate to-be SCOPE analysis for FFT Operational Description 
Conduct follow-up validation/discussion session with FFT Initiative 
team on results of SCOPE analyis 

— Focus on larger context issues, identify any changes 
Use resulting to-be profile to characterize attributes, information 
models, service interfaces, and instance naming approaches, 
conventions, and authorities for FFT 

— Identify those that are driven externally to the FFT capability domain 


— Identify those that FFT Capability domain needs to establish as 
common to FFT systems over the network 


Sample Capability-Specific SCOPE dimensions to be considered: 
— Force Tracking granularity in entity and time dimensions 
— Types of forces to be tracked 


73 


Sample Capability-Specific Dimensions generated by FFT SCOPE 
Planning Workshop 


74 


Sys 1 a0) (=m Or-ler-leli ii aver) el-rer ii (em BD) |)’ 


= Generated in FFT SCOPE Planning Workshop, May 08 with input 
from domain experts and applying SCOPE concepts 
— Force granularity 
— Force element and track types 
— Reporting frequency and latency 
— Track location sensitivity 
— Location precision, accuracy 
— Degree of friendliness and force element affiliation 
— Reporting push/pull 
— Information types reported 
— Tracking purposes 
— Reporting architecture and business model 
— Identity and location assurance 
— Other ways that FFT can vary in depth/breadth? 


75 


OF-Y-o) Or: Ver- loli iiaYare) el-cedhicem DJ ip 1) 


= Demonstrate relevance to target SMEs 
— Dont claim expertise 
— NATO ACT SME’s resonated with strawman set of FFT dimensions 
= Stimulate target SMEs to think multi-dimensionally in scope space 


— ACT SME’s identified 2 additional dimensions in subsequent SCOPE 
Workshop with them 


— Degree of penetration of force structure tracked via FFT 


— Degree of security accreditation required by FFT systems and 
services/features 


= Drive net-centric interfaces/services specification/standards 
— NATO/ACT currently focused only on ground force FFT 


— Acknowledged need for tracking helicopters and potentially CAS 
force element types and vice versa 


— Averse to force element status data exchange as FFT capability due 
to bandwidth concerns 
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Adjacent Domain Exercise for FFTI 


Command and Control (C2), RoE, Planning, Exercises, Execution 


Situational Awareness (often characterized as a sub-domain of 
C2, but also of Intelligence) — includes MDA as a subset 


Intelligence 

Targeting, Weapon/Target Pairing and Release Authority 
Logistics 

Transportation, especially in-transit visibility 

Asset Tracking/Inventory Management 

Force Structure, Readiness and Preparedness 
Force Deployment, “deploy to contact?” 

Civil, Emergency Response, Stability Operations 
Personnel Management 

Business Operations 

JAG, Host Nation Support, and International Legal 
Doctrinal Analysis and Development 
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What information/services from adjacent domains could the focus 
domain use to help achieve its objectives? 

What are the scope and frame of reference issues with the 
information from the adjacent domain from the focus domain 
perspective? 

What information/services produced by the focus domain (FFT) 
could be used by the adjacent domain to help achieve it’s 
objectives? 

What scope and frame of reference issues exist for this 
information from the perspective of the adjacent domain? 

Are there incentive or business model/policy issues associated 
with interacting across the domain? 


Are there other modality/context issues? 
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= Key Information/Service exchanges with FFT? 
— AIS on helicopters 


— Ground force location information to Naval forces in amphibious or 
other naval fire support contexts 


— Naval platform location info to ground/air forces 
= Key data elements and frames of reference shared or mapped 
with FFT? 
= Domain scope challenges? 


— Selective activation/availability of AIS info depending on operational 
context 


Data aggregation of AIS system broadcasts? 
Long Range Identification &Tracking System? (not yet obligatory) 
Some FFT stakeholders don’t view maritime forces as part of FFT 
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= Key Information/Service exchanges with FFT? 
— Provide ship tracking data to FFT 


— Validate ship tracking data by independent means (ships often mis-report their 
track data or actual contents) 


— Help identify who is behaving abnormally 

— Identify nationalities of ship/crew/flagging, ship contents 
— Ships are not under central control 

— Avoid ship collisions 

— Intended destinations, routes, and estimated arrival times 


— Would like to be able to track smaller ships as well as over 300 tons (AIS 
limit), and ships that meet certain profiles. 


— Ships acting as network relays for position/state information 


— Ships become network providers and have to handle security concerns that 
this role creates. 


= Key data elements and frames of reference shared or mapped with FFT? 
= Domain scope challenges? 
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S&R Logistics 


Key Information/Service exchanges with FFT? 


Location info regarding Logistics force elements/assets (trucks, etc. 
Logistics needs to know where consumers are 


Logistics needs to know what consumers need (or inferred from their 
state info). May also need to get some of this from C2/Planning 


Time of arrival estimates/projections; degree of commitment 
Logistics might want to know the contents of a friendly force element 
such as a truck or other vehicle 

FFT may want to know if a force element is “in/out of Supply” — could 
also be a C2/Situational awareness issue. 


Key data elements and frames of reference shared or mapped 
with FFT? 


Location date/time, GPS/WGS-84 for location data but may use UTM 
grid as well. 


— Mode of transportation for tracked element (ground, sea, underwater, 


air, etc.) 


Domain scope challenges? 
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S&R Logistics 


Key Information/Service exchanges with FFT? 


Location info regarding Logistics force elements/assets (trucks, etc. 
Logistics needs to know where consumers are 


Logistics needs to know what consumers need (or inferred from their 
state info). May also need to get some of this from C2/Planning 


Time of arrival estimates/projections; degree of commitment 
Logistics might want to know the contents of a friendly force element 
such as a truck or other vehicle 

FFT may want to know if a force element is “in/out of Supply” — could 
also be a C2/Situational awareness issue. 


Key data elements and frames of reference shared or mapped 
with FFT? 


Location date/time, GPS/WGS-84 for location data but may use UTM 
grid as well. 


— Mode of transportation for tracked element (ground, sea, underwater, 


air, etc.) 


Domain scope challenges? 
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S&R Logistics 


Key data elements and frames of reference shared or mapped 
with FFT? 


— Location date/time, GPS/WGS-84 for location data but may use UTM 
grid as well. 


— Mode of transportation for tracked element (ground, sea, underwater, 
air, etc.) 

— Size/mass of tracked entity, containerization 

— Affiliations and priority of support for entity being tracked 

— Billing of tracked element owner for logistics support provided 

— Specification/direction from logistics or C2 regarding which FFT 
elements are to be tracked in some area or time period 

Domain scope challenges? 
— Tracking aggregation services may support multiple organizations 
— Creates privacy/restricted access considerations 
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= Degree of coupling between operational responsibility and 
execution resource ownership for 
— Network resources 
— Computing platform resources (incl plant, power, etc.) 
— Data resources — including controlled/licensed data 
— Service resources — for proprietary IP or bundled platform/data 
= Business model types connecting consumer with cloud provider 
— Relationship management, consequence management 
= Dynamic range of cloud services (mainly scalability) 
= Network infrastructure capacity between cloud provider and 
consumer 
= Execution platform types provided by the cloud 
= Degree of domain-specificity of cloud-based services offered 
= Others? 
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Types and Measures 


Resource Types: Network capacity, nodal capacities, data 
ownership; service IP, others? SLA management and QOS 
resource management resources 


Coupling types? Common organizational policy, two party business 
models, national affiliation, third party payer models, others? 
Degree of visibility into resources available and degree of control of 
allocating those resources. Different cloud models have different 
approaches to this dimension. For example, different cloud 
providers have different ways to manage resources at different 
levels of granularity and resource type decompositions for 
consumption models exposed to the consumer. 


Should we take the relationship piece of this and include it with the 
top level Business model dimension? A better nomenclature might 
be “Operational Model.” Agreed to keep this as part of the top level 
Relationship Management dimension. What are the motivators for 
the coupling? 
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Degree of Coupling measures? For example, Public vs Private 
clouds is one degree of coupling measure, but is silent on the 
coupling type subdimension. It’s also not a very fine-grained 
measure, in part because there is a presumption that a private 
cloud is enterprise-wide inside (i.e. private) the enterprise firewall. 
But that’s not necessarily so, depending on the enterprise in 
question. 


Responsiveness of coupling? (in time units from demand signal to 
satisfaction?) 


Motivation for coupling? — e.g. money, operational need, shared 
ideology, dictatorship, others 


Enterprise Scope dimensions? 
Net Ready Dimensions for services? 


Geographical coupling? Particular related to the aggregation of 
reSOUIces. 


Degree of specificity of coupling to service consumers 
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consumer with provider 


= Fee for service model 
— Commercial Service Model - fee for service models 


— Public Service Model - free or fee for service (but fee need not fully 
support service — subsidized by a separate body) 


¢ Private Service Model — Enterprise/group membership constrained to 
something less than general public 


= Required Service Model — consumer must use provider service 
(e.g. vehicle registration, tax filing) by force of law/jurisdiction 


= Third Party payer service model — e.g., Google search 
= Community Contributor model — e.g., SETI model, botnets? 
= Other business models? 

— Legacy consolidation, infrastructure consolidation 

— Insurance model (for unplanned events) 

— Charity for goodwill 
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Platform scalability (number of platforms available) 
Storage scalability - how much can be made available and how 
quickly 
Network access capacity scalability — consider Network Entity 
Reach (who can | reach’) 
Types of applications supported by the cloud services 
— Storage services, persistence/access speed tiering 
— Computing platform services (generic platforms) 
— Domain-specific services (e.g, image processing, search services) 
Types of coupling to the physical environment (not common, but 
possible in, say, sensor networks or process control services. ) 
Types of coupling to the political/social environment, e.g., state, 
international; different currencies, languages, legal constraints 
— Coupling to social/entertainment networks, You Tube, Facebook, etc. 
— See also Enterprise Breadth SCOPE dimensions 
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LAN Bandwidths (100Mbit to 10 Gbit) 
WAN Bandwidths and latencies 


Mobile network Bandwidths and latencies 
Dedicated communication links (point to point) 
Low bandwidth and intermittent links 


Asymmetric network links (e.g. satellite with high downlink speed 
and limited or no uplink capability) 


Others? E.g. Cost of network usage to consumer? To Provider? 
Dynamic (on demand) not to exceed some level? 

SCOPE Tech Feasibility dimensions capture this as a fraction of 
available bandwidth. Is absolute bandwidth more relevant? How 
about latency or even availability of the network? 


Intel Instruction set 


Other PC instructions set (e.g, Power PC) 
Small platform set (smart phone, PDA) 


High Performance platforms such as massively parallel 
processors, very large word size instruction set processors 


User delivery platform specificity 

OS Types supported 

Application types coupled to platform types (portability) 
Fault tolerant 


Have someone brief the CC WG on different approaches to 
virtualization and how those might need to be represented in 
cloud services to support interoperability among different cloud 
providers — Kayvium KVM in Toronto Ca? 


91 


General platform services 
General purpose services, e.g. 
— Search services 
— Semantic interoperability services 
Functional domain-specific services. e.g. 
— Retail storefront services (Amazon, Yahoo, E-Bay) 
— Business function services (Salesforce.com) 
— Records management service 
— Tactical vs. Enterprise 
Single-purpose services (e.g., SETI, Human Genome analysis) 
Other gradations or sub-dimensions 
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= QOS measures specific to Cloud Computing? 
Levels of privacy/security/anonymity 
Levels of redundancy and/or physical dispersion 
— Speed of allocation of resources 
— Level of management visibility/control 
= Grid Computing and High Performance Computing? 
= Cloud “outsourcing” services - “private label” cloud instantiation 
and operation? e.g., RACE — business model type? 
= Dynamic formation of clouds? Possibly from other clouds? Virtual 
clouds? SETI, Human Genome analysis 
= Data portability and service level interoperability (beyond net- 
ready dimensions?) 


93 


PANo | F-Vox-d a) mm Dred aat-lismAvarc Uns) cs 


What adjacent domains have information/services that cloud 
computing may need to interact with? 

— E.g.: platform virtualization, business relationship management (e.g., 
IRM/ERP, CRM, billing, demand forcasting, network management, 
application management, DRM, regulatory compliance management 
(e.g., SOX), cyber security, etc. 

What information does cloud computing have/generate that other 
domains may be able to use? 


— E.g: volume of data access requests, data volume stored, number of 
service requests by service consumers, resource units in use, etc. 


Others? 
— Application development 
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